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ABSTRACT 

This report ^summarizes the findings of the 
> .Developmental Continuity Consortium, a collaborative effort of twelve 
r research groups conducting longitudinal studies on the outcomes of 
early education programs for low-income infants and preschool 
children initiated in' the 1960«s« The educational experiments 
conducted were of three general types: (1) home-based parent 
^education programs; (2) center-based preschool programs; and (3) 
! combined preschool center and home visit programs. Data discussed in 
It'his report include (1) data collected independently by each research 

Pfciroup at the beginning of its program and over a number of years 
after the program ended; and (2) follow-up data collected in 1976-77 
jwhen the subjects were 9-18 years old* Heasures used in the current 
^ follow-up study include Parent and Youth Interviews, IQ tests, 
achievement tests, and data from school records. Data w^ere collected 
for program children and their control or comparison group. Combined 
^rejmlts^indicate that (1) early education significantly reduced the 
number of children assigned to special classes ; (2) early education 
reduced t"F^ number of children held back one or more grades ;_ an.d_(3) 
children from all three types of programs surpassed their .controls^ on 
IQ tests for up to three years after the end of the program. Result'^, 
conclusions and implications, methodological problems and further 
analyses are discussed. (SB) 



Documents acquired by ERIC include many informal unpublished materials not available from other sources VtUC make 
effort to obtain the best copy available. Nevertheless, items of marginal reproducibility are often encountered and this affe 
quaUty of the microfiche and hardcopy reproductions ERIC makes available via the ERIC Document Reproduction Service (1 
^ \}~ is not responsible for the quality of the original document. Reproductions supplied by EDRS are the best that can be mac 



us OEPARTMCNT OF MEA1.TH 
t:OUCATlON 4 WELFARE 
NATIONAL INSTITUTE OF 
EDUCATION 




PHO- 

, t ^ ^ w . If f P f 

T ^,^AL 'NS' T.iTt Of 



f^ERSISTEMCE OF PRESCHOOL EFFKITS 





A MATiOIVIAL 



Cai.U\aC3RATIVE STUDY 



111 



TWELVE RESEARCH QnOUmili 



PCJR TVIE 



coMMisaiaiv op 



SEPTEMBER, 1 977 

J 



PM^MISSION TO REPRf)[)nrL THIS 
VIAMUIAI MAS HLE-N ^.RANreO BY 



X 



win 



TO THE Lrnj(V\;iONAL RESUUfKES 
l^Jf Of^iAT ION (FNT6f^ (EfnC) AND 
USERS OF THE ERK SYSTEM 



COMMUNITY SERVICE LABORATORY 

NEW YORK STATE COLLEGE OF . HUMAN ECOLOGY 

CORNELL UNIVERSITY ITHACA. N.Y. 14853 



THE PERSISTENCE OF PRESCHOOL EFFECTS 
A Long--Term Follow-Up of Fourteen Infant and Preschool Experiments 

The Consortium on Developmental 

ContinuiVy 
Education Commission of the States 
* » 

Analysis and Final Report by 
Irving La2ar, Virginia Ruth Hubbell, 
Harry Murray, Marilyn Rosche, and 
Jacqueline Royce 



Final Report; Grant No. 18-76-07843 

To The Administration on Children, Youth and Families 
Office of Human Development Services 
U.S. Department of Health, Education and Welfare 
September, 1977 




3 



Members/Collaborators of the Consortium 
on Developmental Continuity 



Kuno Seller 
Temple University 

Ira Gordon* 
University of Florida 

Martin & Cynthia Deutsch 
New York University 

Susan Gray 

George Peabody College 

Merle Karnes 
University of Illinois 

Irving Lazar (Chairman) 
Cornell University 



Phyllis Levenstein 

Verbal Interaction Project 

Louise Miller 
University of Louisville 

Francis Palmer 
SUNY - Stony Brook 

David Weikart 

High Scope Foundation * 

Myron Woblman 

Institute for Educational Research" 

Edward Zigler 
Yale University 



Central Staff of the Consortium (at Cornell University) 



Virginia Ruth Hubbell 
Harry Murray 
Jane Pedersen 



"'axilyn Rosche 
Jacqueline Royce 



Project Director 

James Peterson 
Education Comirission 
of the States 
Denver, Colorado 

V . 



Princ i pal Consultants 
Bernard Brown (ACYF) 
Richard Darlington (Cornell) 
Robert McCall (Boys Town Inst.) 



* Dr. Go*. don is now at the University of North Carolina at Chapel Hill. 



This report was prepared by the Chairman and the Staff of the Consortium 
Inquiries should be addressed to The Chairman at N-135 MVR Hall, Cornell 
University, Ithaca, New York 14853. / 



'4 



•-li- 



g 



^ would be impractical to acknowledge a] 1 of the people whose 
I help made this complex collaboration work so well as it has. We wish tc 

\ particularly thank some of those who made important contributions to the 

\ quality of our work. \^ile the remaining faults are ours, they deserve 

--\ — some- of the credit for.its strengths,, _ / 

^ Edith Grotberg and Bernard Brown of the Administration for Children, 

' ^^^■^outh and Families (DHEW) helped us think through critical issues in 
selecting our variables • 

James Peterso.. and Homer Elseroad at the Education Commission of the 
States opened the doors for cooperation by public school systems across 
the country. 

Richard Darlington, Urie Bronf enbrenner , John Doris, Henry Ricciuti, 
Steven Caldwell and Jay Millman of Cornell, and Robert McCall of Boys 
Town, served as consultants, critics, and advisors throughout the 
process of selecting data treatment and interpretation alternatives. 

The research associates of the members of the Consortium worked 
well beyond their forma] obligations 'to find and gather this enormous 
body of data. ^ z-^" ^ . 



ERLC 



4^ 



-iii- 



TABLE OF CONTENTS 




PART I. INTRODUCTION 

A. Background ' ^ ^ 

B. Formation of Consortium 

C. Description of Studies 

ft ' 

D. Consortium Problems'; Decisions 

E. Problems of Secondary Analysis 

F. , Problems of Longitudinal Analysis 

G. Overview of the Analysis 
PART II. DATA COLLECTION METHODOLOGY 

A. QTriginal Data 

B. Follow-up Data 

PART III. COMPARISON OF SAMPLES ACROSS PROJECTS 



PART IV. ANALYSIS -O? PROGRAM AND CONTROL DIFFERENCES IN 
COGNITIVE FUNCTIONING. 



/ 



\ 



A. Analysis of Stanford-Binet IQ Scores /tram Immediate 
Posttest to Thrct Years after Program'^termination 

B. Analysis of WISC-R IQ Scores * ^ ^ 

C. Summary of Results of the IQ Testing 

D. Anal>)^s of Assignment to Special Education and 
Grade %Mlure ^ 

^ E. Analysis of Schooling V^ariables from Youth inttrvLew 

i 

PART V. ANALYSIS OF DFXIVI'RY SYSTEMS 

A. Parental Evaluations of Programs 

B. Program Variables Analysis ^ 
CONCLUSIONS AND IMPLICATIONS 
Cone i us ions 



PART VI. 
A. 
B. 



ERLC 



Implications and Recommendations for NationnJ 
Policies and Programs 



6 



1 

5 
7 

14 
21 
?2 
25 

27 
28 
35 



47 

58 
61 



62 
82 

85 
91 

107 
109 



V 



PART VII.' FUTURE TASKS ■ 
• k. WISC-R 

B. Achievement Tests 

C Special Education and Retention 

D, Interview, Responses 

E. Who Benefits from Wh^tV When, and for How Long? 
F» Developmental Questions 

PART VIII. APPENDICES 

A. Status Report 

1. Introduction 

2. Consortium Meetings 

3. Presentations Given 1976-77 

4. Status by Instrume^nt 

H 

B. Technical Supplements ^ , 



1. Sample Selection and Assignment 

2, Follow--up^Data Collection and Data Analysis 
Methods (Reliability, Respprse Rates) 



3. Attrition 



> 



A. Relationship of Current Results oiySpecial 
^ Education and Grade Failure to "p/eliminary 
Findings of the Developmental Continuity 
Longitudinal Study" ^ ^ \ 

5, Glossary 

6. Instruments and Instructions 
C. Papers Presented 



-V- 



LIST OF TABLES 

Table 1: Summary of Studies * 13 

Table 2: Comparison of Projects on Pretest Stanford-Binet IQ 39 
Table 3: Compari^-on of Projects on Mother's Education 
Table 4: Comparison of Projects on Head of Household SES 



41 ^ 
A3 



Table 5: Mean IQ's for Experimental and Control by Project 54 

Table 6: Comparing Program and Control on Stanford-Binet IQ . 55 
Score - Pooled z's and Significance for t-tests by 
// Years after Termination of Early Education 

Table 7: Comparison of yt-test results with Regression on 56 
Effect of Pr^ram 

Table 8: Pooled z's Substituting in Regression Coefficient 57 
Where Available * , 

Table 9: "Comparison of WISC^IQ's bx Project (60 

Table 10: Effects of Early Education on Special Education for 74 
Five Projects , J ^ 

Table 11: The Effect of Different Curricula on Assignment to 76 
£^pecial Education 

Table ]2: Effect of Early Education on Grade Failure f^Pr Five 77 
^ ^ Projects' ' ^ 

Table 13: The Effect of Different Curricula on Grade Failure 79 

' Table 14: The Effects of the Micro-Social Learning System on 80 
Grade Failure ' ^ ' 

\ 

Table 15: The Effects of the Micro-Social Learning System on 81 
Assignment to ^Special Ec|,ucation 

Table 16: Self-evaluation of School Work by Program or Control 83 
Status (older project sites only) 

Table 17: Responses to Parental Interview Question "Was the 86 
program a good thing for your child?" By Delivery 
System 

Table 18: Answers to Question "\^^at did you like best about §7 
the program your child was in?" By Delivery System 



8 



Table 19: Responses to Question_"Did you like having the ^89 
program in a home/cjenter?" By Delivery System 

Table 20: Correlat;Lons between Immediate Posttest IQ and ^ 96 
Treatment-Control Status 

Table 21: Matrix of Program Descriptions 97-104 - 

.Table- 22: Z-Score Computation for Between Program Variable 105-106 
Categories 

Table A-1: Number of Cases Received by Sfeptembej 30, 1977 for A-9 - 
Each Instrument by Project Site 

Table A-2: Number of Cases in July 1, 1977 Computer^ile for ' A-10 
Each Instrument by Project Site 

Table B-1: Primary Source of Subjects ' .'^B-H 

Table B-2: Sample Selection Criteria Used by Projects , ^ B-18 

Table B-3: SES Selection Criteria A ^ < 'B-19 

Table B-4: Response Rate Computations and Final - B-30 » 
Dispositions for Six Sites ^ ^ 

Table B-5: Final Sample as a Percent of OT;iginfi' Sample 'by B-47^ ' 
Project ^ ' ' K'^' ^ 

Table 06: Elinal Saipple as a Percent^ of Original Sample df B-^ff^ 
.Parent Interview, bVt'rojectv, , 7^ * 

Table' B-7: Final^ample ^s a/Terceiif of 0rig/n»l for ycmth , B-49^ ^ 
^ * by P^ject • y ' 

, Table B-8: Final Sample as a Percent of Original for School B-50 ' 
^ Record Form by Project 

Table B-9: Final Sample ^as a Percent of Originpjl fo^#^V/ISC-R B-51 

by Project ^ . V 

Table B-10: General Attrition - Comparison of Pretest - B-52 
Stanford-Binet IQ Scores 

Table B-11: General Attrition - Comparison of Hollingshead ^ B-53 
ISP- Ccores 

Tabic B-12: General Attrition - Comparison of Mother's B-54 
Education 



9 



^^^^ 

-vix- * 



Table B-13: Attrition on the Parent Interview - vC^pmparison B-55 
of Pretest Stanford-Binet IQ Scores/ 

Table B-14{ Attrition on t^e Parent Interview - Cujnpar^on B-56 
of Hollingshead ISP Scores 



^^^JTable B-15: Attrition on the Parent Interview^ - Comparison B-57 
— -~^__qf Mother's Education 

Table B-16: Attrition on the^lTbutli^Intervl-ev^-^^XomEl^ of B-58 
^ Pretest Stanford-Binet IQ Scores 

Table B-17: Attrition on the Youth Interview - Comparison of . B-59 
Hollingshead ISP Scores 

liable B-18: Attrition on the Youth Interview - Comparison of B-60 
Mother's Education 

* 

Table B-^19:' Attrition on the School' Record - Colfiparison of " B-61 
J, \ Stanford-Binet IQ yScores c 

^ ** ^ ' Tible B-20: -Attrition cn the School Record - Comparison of B-62 
* * ^ Hollingshead ISP Scores 



erJc y ' 10 



Table B-21: Attrition on the School Record - Comparison of B-63 

Mother^ s E3ucation ^ 

* Table B-22 : AttritionVnu^the WISC-R - Comparison o^ Pretest^ B-64 

Stanford-Binet IQ Scores^ ^ ^ ' ^ 

\ 

Table ^B-23: Attri\tiotf on' the KISC-R - Caparison of ^ , B-65 

^ Hollingshead ISP .Scores * vi' ^ > 

\ Arable B-^4: Aetritiop on the WISC-^. - Comparison of Mother's B-66 
Education ^ * 



^^Tab^B-25: Expected Humber of Chance "Signif;icant FindingJ^ B-67 
and Actual Number of Significant Fit^dings for L 
Tables B-10 to B-24 ^ ' ' 

r 

Table B-26: Results of 3 Way ANOVA: Significance Levels B-68 

Tab"^ B-27: /^trition o.i the Original Data: Comparison^ of B-69 
Stanford-Binet Pretest IQ Scores 

* Table B-28: Att^rition on the Original Data: Comparison of B-70 
ISP Scores 

Table B-29: AttrlCion on the Original Data: Comparison of B-71 
Mother's Education 



-vii- 



LIST OF riGURES 



Figure 1: Homogeneous Groups of Projects on Pretest 
Stanford--Binet IQ for the Original Sample 

Figure 2:. Homogeneous Groups of Projects on Pretest 
Stanford-Binet IQ for the ^Follow-up Sample 



Figure 3: Homogeneous Groups of Projects on Mother's 
Education for "the Original Sample 

Figure 4: Homogeneous Groups of Projects on Mother's 
Education for the Follow--ixp -Sample 

Figure 5-: Homogeneous Groups of Projects on Socio-economic 
^ Status for the Original Sample 

Figure 6: Homogeneous Groups of Projects pn Socio-economic 
Status for the Follow-up* Sample 

Figure 7: l^ercent of Program and Control uhi^ren in 
^ Special Education * 

Figure 8: Percentage Reduction in Children in Special 
Education 

Figure 9^ Percent of Program and Control Cljildren Held 
Bac^ a Grade * 

Figure 10: Percentage Reduction in Children Held Back in 
N Grade 



( 



11 



The Persistence of Preschool Eft'c^cts 
First 'Year Report, 
Abstract 

I. Overview 

The Developmental Continuity Consortium is a collaborative effort of 
twelve research groups conducting longitudinal studies cn the outcomes of ^ 
early education programs. This report summarizes the findings of current 
analyses of longitudinal studies of low income children who ^participated 
in experimental infant and preschool programs initiated in the 1960*s.. 

II. Methods 

Th-se educational experiments were of tl:iree general t^pes: (1) homebased, 
parent educ nCion- infant programs. (2) preschool center programs, and (3) 
combiwed preschool center and home visit programs. The two sets of data 
discussed in this report include 1) data collected independently by each 
research group at the beginning of thei?- program and over a number of years 
after the program ended; and 2) common follow-up data collected in 1976-77. 
These low-income youngsters, who are predominately black, now range trora 
nine to eighteen years of age. Parent and Youth Interviews. Uechsler IQ 
scores, achJ.evement test scores, and data from school records were collected 
in the current follow-up on program, children and their control or comparison 
group. Methodological problems inherent i.V longitudinal research and secondary 
analysis such ns attritiort- and sample selection variations are discussed. 
Strategies Lor investigating program characteristics (age and length of 
intervention, curriculum types) are proposed lor future" analyses. 

• • • 

III. Findings 

The results analyzed' thus far show that investments in early education 
have long term benefits in three areas: 
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1) S^) ecial E ducation Ass^^unent:- The combined evidence fiooi prcfject 
sites which collected this data shows that early education sig- 
nificantly reduced the number of program children assigned to 
special educational classes . 

2) In-grade retention. The combined evidence from seven project 
sites able to collect this information indicates thnt early 
education significantly the number of children held back 
one or more grades. \ 

^) Cogn itive measures . The children from all three Isypes of programs 
surpassed their controls for up to three years after the end of 
the program on the Stanf c^d--Binet . This significant difference 
appears- to last through the primary grades. Current Wechslcr 
results show only the youngest program subjec ; with IQ scores 
significantly higher chan their controls'. 
Attrition analyses indicate that over all, there were no significant differ-- 
ences between the early demographic and cognitive characteristics of those 
subjects fo'ind and those not found for follow-up study. Less than 3% of 
those contacted refused to participate in the follow-up study. 

_l V . Cone lusioris 

'iho most important fin^^'Inp, is that low Income children who received 
early educat. ion are better able to meat tK^ minimal requirements of their 
schools as shown in reduced rate of assignment to special education and in- 
grade retention. In addition, the preschool programs improve cognitive 
skiUrff into the primary grades as measured by the St.inford-Binet . Par»^nta3 
satisf .K'Lion witli programs was high as measured on the follow-up inter- 
views. Preliminarv «uuilyses indicate significant differen in attitudinal 
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responses such as program children rating themselv^es better than others 
in their school work compared to their controls. 

V. Implications 

The implications are that well planned curricula for young children 
in day care and Head Start are likely to reduce later costly special 
education or remedial programs in schools. 



PART I 
INTRODUCTION 

A* Background 

Alexis de" Tocqueville , writing at a tire when broad generalizations 
were still respectable, observed that Europeans tended to accept their 
stations in life and to try to improve conditions within their stations, 
whereas Americans assumed that they could chang. their station through hard 
work, virtue and talent. While in recent years we have added the idea of 
opportunity, de Tocqueville's generalization about Americans can be 
defended today. 

Head Start was built on the assumption that early education, parental 
involvement, and the provision of medical and social services could enable 
children of poor parents to achieve cognitive parity with their middle- 
class peers, aftd leave the ranks of the poor. 

From this traditional American premise, a vast array of programs and 
curricula emerged. The age of entry into programs, the length of interventi 
the settings, the teachers, and the materials employed all varied in a pro- 
fuse diversity of programs for low-income children and their families. 

Twelve years later, with sufficient numbers of program children in 
their later years oS childhood and adolescence, it became appropriate to 
take stock of outcomes. 

This repo. t^escribes the findings of fourteen longnudinSl studies of 

low- income children^ who participated in experimental infant and preschool 

/ 

programs prior to 1969. It was conducted as a collaborative effort by a 
dozen investigators who agreed to collect common follow-up data in 1976-77. 
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We believe that the findings in this report now leave no reasonable 
doubt that in the main, programs which had deliberate cognitive curricula 
had a significant long-term effect on school performance. The findings 
are both too conservative in the methods of data analysis from which they 
emerge and too dramacic in their consistency and size, for the main effects 
they found to be spurious. The critical questions they address could, we 
believe, be addressed only by longitudinal methods. 

Longitudinal data provide the most valid and direct way of 
Assessing the cognitive, social, emotional 'and familial outcomes of programs 
for young children. Scientifically useful longitudinal data are also the 
most difficult to obtain, and longitudinal studies are the most difficult 
to design and maintain. 

Intervention programs typically have small N's; our mobile society 

produces high attrition;' changes \n psychometric technology , make baseline 

measures obsolete; changing political climates can suddenly cut off access 

to data or research funds. Further, poli cy -makers are rarely content to 

\ 

wiiit for findings — but children's growth cannot be hurried by electoral 
calendars . 

Hie demonstration thai investments in early education have long-term 
benefits that arc both humane cuid fiscal cannot bjlp but quell the doubts 
that have effectively frozen such investments ^or almost a decade. 
Theoret i cal Significance 

In recent years, there has been a resurgence of the perennial 
populist-elitist debate about the malleability of the cliibrs mind. It 
is perhaps symbolic that today's most eloquent champions jf the elitist 
position speak from positions at our oldest — and traditionally, most elite 
nnivcrs Uy. It is from Harvard that we hear that intelligence is primarily 
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genetic (Herrnstein) ; that anything thdt can be done must be done before three 
years of age — and then by a supeirmoni who stays home (White); that early 
trauma will be "outgrown" anyway, without the taxpayer's investments (Kagan) ; 
and that, in any event, if a poor kid makes it, it's purely a matter of luck 
(Jencks). This modern echo of Cotton Mather is also part of the American 
experience, and only the clearest practical demonstration that talents, 
learning ability, and capacity for social development are widely distributed, 
and can be actualized by appropriate stimulation, will permit continued 
national investment in Head Start's role in the search for ways of increasing 
human capabilities. The ideological ^and theoretical arguments' are not new. 
What is new is the opportunity to move part of the debate from the realm 
of speculation to scientific test:. That opportunity exists because of 
the investments in early intervention of the sixties, and CCD's decision 
to risk the outcomes of longitudinal studies. 

CCD has^been no stranger to longitudinal studies. Where other 

federally supported longitudinal research usually did not involve specific 

% 

interventions (Perinatal Study, Children of Kauai, Berkeley Growth Study), 

the ETS Longitudinal Study,-, the follow-ups of children in the PCC's and the 

PCDC's, the current ' studies of Home Start, and thi« research ail have the 
potential of testing the developmental hypothesis; of reaching rew insig' ts 

1 :o the relationship between early experience, the conditions and settings 
'of a young child's life, and the behavioral, social and educational outcomes 
of planned early intervention. 

The reader is asked to keep a few caveats in mind as (s)he reads this 

report. 



(1) While the curricula and delivery systems used in these experiments 
can be found in Head Start programs in many places and could b-e easily 
adopted by others, and while fhe children were typical of Head Start's 
populations, these were not typical Head Start programs. They were 
experimental programs. They varied in ages, frequency and duration of 
sessions. However, some were actually Head Start sponsored, and current 
Head Start quality standards are such that similar curricula are likely 

to be part of typical Head Start programs. 

(2) These studies,- with a few exceptions, were not initially designed 
as longitudinal studies, nor were they designed for later comparisons or 
pooling of the data. This is a-secondary analysis, and th-^.re are very 
real limits on the amount of information that was common a cross studies 
when tliev collected their initial baseline information. However, they are, 
witli a few exceptions, all the existing studies that can be used for th^"^ 
investigation of long-term effects of early intervention. It would take 
another fifteen years (an^ at least five million dollars) to create a 
similar sample. 

In this^ report we describe in detail each of the analyses and their 
limitations so that technical readers can assess our methods and conclusions 
for themselves. Some of the questions for which we now have the data will 
need to be dealt with in future reports. This report includes in 
its anah'ses raw duL.i received up until the first week of Jul> , 1977. More 
datci h.WL- heeii reccivoJ since then, and the quantities of such additional 
data are Lndicatetl. I'ulL information on all l(>catcd subjects vJilL 
probchly not arrive until late in October. 

Not all comparisons include all project sites. This is due, not to 
deliberate selection on our part, but to the availability of the data nt 
time of analysis. 

is 



B. Formation of t he Consortium 

The idea of this Consortium arose out of at least four interests 

that converged in 1975. 

- Sevt/al of the investigators were very much concerned with finding 
ways to follow their original subjects, primarily for scientific 
reasons, 

- There was a building band-wagon of professionals who wereN^ 
denying the importance of early experience or continuity of ^ ^ 
experience in later life - an idea which, to many other profes- 
sional^, not only defied common observations, but was based upon 
what they felt was very flimsy and highly selective .evidence- 

- Tnerfi were clear indication' particularly in published budget 
projections, that the Office of Management and Budget sought to 
severely reduce federal expenditures for young children. The 
virtual abolition of all ^rt custodial requirements for federally 
supported day cnre seewed a harbinger of the future. 

- A nuiPber of state governments were seeking help in selecting a 
sensible policy in r<igard to early childhood programs^. 

During 1975 a number 6t the investi-gators who were attending a 
national .neeting met informally and agreed that the only proper "test" of 
,the effects cf early experience was to seek out children who had been 
subjects in early intervention studies long enough ago for any effects 
to have appeared. The early intervention studies of the late 1950's 
and early I960's seemed a fruitful source or such persons. 

o 

Irving Lazar. of Cornell University, who Wcis then examining the 
research issues relating to the continuity of development fo** the 



Social Research Group at George Washington University and serving as 
an advisor on program development for the Education Commission of the 
States, was able to obtain some travel funds to call together persons who 
had directed early intervention programs which had certain basic 
characteristics: - . _ 

- They bad completed their studies prior to 1969. 

- They had large enough original samples so that a recovery rate 
of 30% would still be a statistically usable number. 

- They met some basic conditions of experimental design. 
, - They had made some effort to follow their subjects. 

- They had explicit and standard intervention programs, so that 
the content of the child's experience could be specified. 

At the initial meeting, sponsored by the Social Research Group, 
two other investigators with sizable numbers of subjects were nominated 
for inclusion in the proposed collaborative arrangement. One of these 
accepted the invitation; the other made no reply, and since his data had 
not been made available to the scientific community:, no further pursuit 
was- undertaken. 

Because of the importance of the proposed follow-up to state governments, 

the Education Commission of the States, which serves as a policy research 

. organization for forty-nine state governments, offered to sponsor the 

Consortium effort. 

At a second meeting of the Consortium group, certain basic agreements 

were undertaken: 

(1) Each member would turn over a set of his/her original data and follow 
up data for central processing to a group who had not been 
involved in any of the studies. 

& 20 ^ 
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(2) Each member would retain "ownership" of those data, in the sense 
that he/she could review in advance the uses which the central 
group would make of them and retained full rights to publish his/ 
her own findings. The Consortium could use the data for its 
common purposes, but only individual investigators could release 
the raw data to others. 

(3) Each member agreed in advance to collect a common set of protocols, 
to be jointly arrived at, in the new follow-up. 

It was declared that Dr. Lazar would chair the Consortium, would direct 
the data treatment at Corno.li, and would take the lead In seeking financial 
support for the studies. 



C. Description of Studies 

The intervention studies -included in this report were designed to 
^determine whether an individual program with . children had durable results. 
They involved treatments which varied as a functix^n of the theoretical 
disposition of the principal investigator. Age, type, duration, and 
intensity of intervention varied from study to stud.y. Most of the 
programs were begurr in the early and middle 1960's. Federal funding 
was obtained from various sources, including the Office of ^Economic 
Opportunity, thi U.S. Office of Education, the Children' s, Buraau , 
the National Institute of Mental Health, and the National Institute of 
Child Health and Human Development. Additional support cair.e from private 
funds, notably from the Carnegie Corporation and Ford Foundation. Wl.ile 
each of the intervention studies was originally designed to determine 
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whether a particular treatment (or treatments) was effective, as a group 
they provide an answer to whether or not intervention as a concept is 
eflectivo. 

The studies from which the data presented here were drawn may be 
grouped by delivery system into three categories.. Home-based delivery 
systems direct their educational efforts primarily toward the parent, 
usually the mother, as the major instrument of change and influence 
'in the child's life. Activities, toys, and games areibrought to the 
family home by a "home visitor" who trains the mother to use the 
activities and to promote .her child's development through parent-child 
interaction. Center-based programs provide more or less structured 
nursery school programs for children. In^'^ction usually occurs in 
small groups but in some cases is on a one-to-one basis. Parents are 
kept informed about the program but are not actively involved in day-to- 
day, intervention. Each combination program consists of a center-based 
nursery school program coupled with a periodic home visit in which both 
parent and child are involved. 

The characteristics of the studies included in this research are 
summarized in Table 1. Below is a brief description of each of the 
programs. Additional information, such as the details of sample selection, 
jire included elsewhere in this report. ' 
The Ph i lad e lj)_h ia Pro j e c Dr. Kuno Beller 

Dr. BeLler's program studied the effects of variations in the timing 
of entrance into preschool or school. Three groups of children were - 

0 

involved. An experimental nursery school was provided through the school 
system for a group of four year old childre^n. Classes of fifteen children, 
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attended by a head teacher and an assistant, operated four dayt; a woek. ^ 
A second group of children began regular public school kindergarten at 
age five, and a third group entered school in the hrst g^^e^at age 
six with no kindergarten preschool experience.- f 

Institute for Developmental Studies ; Drs. Martin and Cynthia Deutsch 
/ . The Deutsch' s program examined the effects of a specific intervention 
program on several sample waves of children from low-income areas in New 
York City. They compared each of these lo three control groups of children ^from 
the same areas. Their specifically developed curriculum, which began vith 
a preschool program and extended into elementary school through third 
grade, emphasized language development, concept formation, perceptual 
and overall cognitive development, and the child's self -concept . 
The Parent Education Program ; Dr. Ira Gordon. 

Dr. Gordon's project provided home-visitor, parent-focused intervention 
during the middle 1960's to children from three months to three years .old. 
This study was specifically focused on the enhancement of the intellectual _ 
and personality development of the child and the production of changes 
in the mother's self-esteem and in her conviction that she could affe^ct 
what happened to herself and her child. Gordon utilized trained para- 
professional home visitors who worked with each mother once a" week. The 
sequenced curriculum emphasized PJ^agetian concepts .a^Jro^riate to the 
child's stage of development. One treatment Voup received weekly visits 
for two years, starting when the child was three months old; a second, 
visits from three months to one year of age; and a third, visits from one 
year to two years of age. 
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As the chilcfren reached two years of age, they entered Gordon's 
Home Learning Center Program for an additional year. This treatment 

✓ 

continued weekly home visits to the parent, but added a twice-weekly 
four hour group experience for five children at a time. The "backyard 
centers" were located in the homes of the families in tfie project. 
Early Training Project ; Dr. Susan Gray 

Dr. Gray's program utilized a single intervention model but implemented 
it through two delivery systems, a center-based summer program and a home 
visitor winter program. The project was directe'd towards developing the 
child's attitude.- and aptitudes. conducive to school success, as well as 
his or her general competence, and towards encouraging the parent to become 
a m'ore effective teacher of the child. 
Family-Oriented Home Visitor Program ; Dr.^Susan Gray 

This home-based program focused on enabling the parents -to become 
more effective educational change agentr with their small children. Home 
visitors worked with the mothej/and toddler plus one other child to l^nprove 
the mother's effectiveness as an educational change agent. This took 
place weekly for eight months. The entire family was involved wherever 
possibie. 

r m-riculum Comparison Study : Dr. Merle Karnes 

In this s,tudy, aach of five groups of t>resct;o;i children attended 
programs offering different curriculum models: Bereiter-Engelmann , traditional, 
Community-lntegray , MontHsori, and Dr. Karnes' concept development cur- 
riculum! Each group attended one of the preschool models for about two 
hours a day for seven to eight months. 

i 
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Mother-Child Home Program : Dr. Phyllis Levenstein 

Dr. Levenstein' s program used commercially available toys taken by 
"Toy Demonstrators" to homes in an urban area of Long ''^iland. Visits with 
mothers and infants on a weekly basis concentrated on improving verbal 
interaction, attempting to prevent educational disadvantage through early 
cognitive and affective intervention. 

Experimental Variation of Head Start Curricula : Dr. Louise ♦Miller 

Dr. Miller's study compared the benefits of ^our established preschool 
programs: ?Iontessori, B'ereiter-Englemann, DARCEE, and a traditional 
nursery school program. Each group attended a six-hour daily program at 
age four, followed by either a traditional or academic kindergarten 
program at age five. One half of the DARCEE group received home visits in 
addition to the center-based program. 

N 

H arlem Training Project : Dr. Francis Palmer 

Dr. Palmer's study provided one-to-^one center-based intervention 
followirag two. models: a Concept Training Group and a Discovery Group. 
The experimental children attended one' or the other of the programs for 
one hour, twice weekly, for eight months. 

Perry Presc! )ol Project : D/. 'David Weikart • ^ 

This program provided academically high-risk children with a 
cognitiyely-oriented preschool program fpr two years before the children 
entered kindergarten. Five cohprts of children were studied over a^ 
period of thirteen years. 

Curriculum Demonstration Project: Dr. David Weikart 
■ 7— 

This project utilized three curricula: Bereiter-Engelmann , cognitive 
training, and a unit-based or traditional model\ The children attended 




a half-day program and were visited by a teacher once a" week over ^ tvo- 

year period for 90-minute per iods_of instruction. 

Games ie-IfffanTTrosram : Dr. David Weikart 

Dr. Weikart' s hpme-based infant program provided a series of lessons 
to very young infants and their parents. The curriculum emphasized the 
develop.aental theory of Piaget and stressed the facilitation of the 
growth. of mothers as teachers. \^ 
Micro-Social Learning System : Dr. Myron Woolman 

Dr. Woolman studied the effects of a 'preschool program utilizing 
an arrangement of modular units in which children worked -through a pre- 
planned tseries of activities. They received periodic irei^f orcemen^ as ^ 
the', completed each objective in a sequence. The program design also 
included a life-simulator space in which the children applied their newly 
learned skills in free play. ' This aspect of ..le program utilized materials 
and equipment designed to provide unstructured free response favorin, r 

V-' 

Int-eractive play. ^ 
'Hpari Start and Follow Through New Haven Study : Dr. Edward Zigler 

This study investigated the effects of regular Head Start a d Follow 
Through interventions, on two cohorts of preschool children in New Haven, 
Connecticut, using measures of academic achievement, IQ, and social- 
emotional development. The original group has now been followed through 
the eighth grade. 
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center-based 


4-5 






late '60's 




i^eaming oyoi.tii.i 

Head Start & Follow 
Through New Haven 


Dr. Edward Zigler 


New Haven, Conn 


center-based 
— , — ^ — 


5 






mid '60's 


ocuay 















28 





















D. Consortium Problems, De cisions^ and Notes on the Environment of the 
Study 

Once the basic decision to collaborate in, a longitudinal study was 
undertaken, and it was agreed that all the original and, follow-up data 
would be treated by a group who had no vested interest in the outcomes 
and had not participated in any of the original studies, three major 
kinds of decisions needed to be made: 

- The variables and measures to be included in the follow-up* 

- Decisions and choices in statistical treatment cf the data, 
" Reporting, dissemination and interpretation of the data* 

The Decis i ons on Data to Be Collected . ^ 

The major constraint in the conduct of this study was fiscal* 
It was extremely difficult to find support for this research for a variety 
of reasons: 

- There had been widespread publicity about the Wes tinghouse-Ohio 
University Study which was interpreted as meaning that there 
were no educational benefits from preschool education- The 
methodological problems in that study, built into the design 
prescribed by OEO were never widely understood. Private foundations 
we approached did not believe we could find any effects after 

ten years* The interpretations by Jensen, Jencks, Hernstein and 
Bronfenbrenner reenforced their expectation of nec^ative findings. 

- Mc'»ny federal personnel were fearful that another follow-up study 
would simply serve to hammer the final nails into the coffin 
then being built for He^id Start by the Administration in 1975. 
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- Many people believed that a consortium of this kind could never 
work - that a dozen senior and independent investigators would 

f A 

never agree on a single study design, or stick with it. 

» /• 

- Others felt that after a decade it would be impossible to find 
enough of the original samples to have any meaningful data. 

There was interest among sophisticated .decision makers in having something 
substantial upon which to base decisions about programs for young children. 

- Governors were faced with decisions on state investments in 
services for young children. 

- There was considerable pressure to make permanent the elimination of^ 
educational requirements from the Federal Interagency Day Care 
Requirements. This pressure was ^'justified" by the assertion that 

^ early education had no benefits worth the cost. 

- Thoughtful politicians of both the right and the left questioned 
the assertion of no benefit, noting that half of middle class 
families purchase preschool services and have for almost a century. 
It seemed unlikely that so many consumers could be so wrong for 

so long a time. 

The Office of Child Development agreed to take the risk of financing 
what many thought to be a hopeless task. The amount of money they could 
make available while substantial iri toto, meant that each investigator 
would have to locate, interview, test, gain access to, and record school 
da^ta on youngsters, and ir terview their parents for a total cost of about 
$250 per family. This is a small fraction of the cost-per-subject of 
other longitudinal studies. This limitation meant that we could not afford 
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to make more than one contact per subject. Ths^t in turn limited the amount 
of informati^^(l which could be collected. 

Consortium members were torn between their personal wish to use that 
contact to examine socio-emotional variables and the public policy need 
to investigate cognitive variables • The public policy needs won out. 
Further, although IQ scores seemed not the most relevant of the cognitive 
measures which could be chosen, it was recognized that the prior public 
storms about IQ would cast doubt on the credibility of any other findings 
If IQ's were not also examined. 

V f 

Thus the battery chosen: the WISC-R, the interviews, the school 
records, and, with reluctance, the school-administered achievement lests. 
Most of the group had grave doubts about our ability to use the achievement 
test data collected by the schools. Indeed the problem of treati'-.g those 
data has been the most vexing and time consuming methodological problem 
we have faced. 

, As it turned out, even the sparse allowance per-case we projected 
was wrong. We an t ic i pat ed ^1 ocating between a third and a half of the 
original subjects - i f we were lucky^ As the reader can see, we struck 
a jackpot and retrieved ovcx:. 2/3 of the original subjects. And we 
kept running out of monev. 

'Many of t h(> insiilut ions which employed the 1 av(>s t i ga tors , recognizing 
the unique and poti^nt ia 1 J y important nature of the data, were persuaded to 
contribute all or most of their normal overhead costs. Several investi- 
gators gave up thoir summer salaries. StippHes, ccjuipment, and 
telephone costs somehow ROt largely absorbed. Some of the deans and 
business offices developed sudden blind spots when passing the offices 
aria research spaces co-opted by the consortium. 
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Indeed, as it turned out, keeping peace between the iavestigators 
was never a problem. Long standing differences were set aside, minimal 
time. was spent on trlvlcil debate, and decisions, once reached, were 
accepted* The Chairman's job turned out to be a combination of stringent 
fiscal management, begging, coping with school district lawyers and 
running interference with university administrators* A dedicated central 
staff coped with the data and kept in continuous touch with the research 
teams in the field. ' 

Decisions and Choices in Statistical Treatment 

Both secondary analyses and longitudinal research are activities ' 
noted for the size and frequency of their hazards and mazes. In combining 
both of them we knew that our own statistical skills would need supplementation. 
Many of the investigators, in addition to being leaders in Child 
Development, are supeifb methodologists and have excellent, staff . All considered 
the problems their own and gave Ireely of their time and skill. We want 
to particularly acknowledge the assistance of John Madden (of Phyllis 
Levenstein's staff), Frank Palmer, and Mike Woolman. 

Additionally we drew upon consultation froni methodologists totally , 
removed from the projects. Profs. Richard Darlington, Henry fticciuti> 
John Doris, Steven Caldwell and Jay Millman, all of Cornell, were consistently 
generous with advice and information. Dr. Robert McCall, of the Boys 
Town Institute and formerly of The Fels Research Institute, .shared his 
unique experiences with the treatment of longitudinal data. Dr. Bernard 
Brown, of CCD's research staff, was a constructive partner in every 
stage of chis study, and helped us in innumerable ways. Prof. Urie 
Bronfenbrenner (also at Cornell) served as "heavy" critic, and periodically 
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helped us re-examine thu validity and meaning of our procedures. And 
finally, the Social Science Research Council's Committee on Longitudinal 

Methodology offered to critique the whole study. 

if 

Initially^ believing that readers would understand that this was\ 
of necessity, a heuristic investigation, we* intended to use the usual 
methods of standard-score conversion to pool all of* the data across 
studies. We rapidly discovered that finding positive effects touched a 
number of raw ideological nerves, and that we could expect td be attacked 
for not meeting the standards of a single, planned experiment carried out 
entirely in a laboratory with caged animals bred for the purpose of the 
study. While no 'field-based study of real people can meet the design > 
criteria of a laboratory experiment, we came to the conclusion, after 
seeing the initial data, that in order to at least reduce' resistance to ^ 
these findings we would use the most rigorous and conservative data for 
treatment choices available. These choices have minimized the findings, 
just as the two sampling anomalies we found (i.e.. Palmer and Miller) 
minimized differences between experimental and control populations. 

Since there are virtually no^ other examples of so many fully in- 
dependent tests of a single central hypothesis, conducted over so long 
a period in contemporary social science and brought together in terms of 
comparable data, we trust that the reasonably objective reader will 
understand what these findings are - and what they are not. 

In general. Consortium members discussed treatment choices thoroughly, 
and helped central staff understand the limitations of their own data. 
Acting the way Si^iciitists are supposed to, they were remarkably non-"def e isive 
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about their data, cooperated full}^ in providing information as best they 
could, »and never attempted to interfe're with tht independence of the Cornell 
group in treating and interpreting the data.^ 
ReportinR, Disseminating, and Interpreting the 'Findings 

At the first meeting of the Consortium, it was recognized that 
proTopt reporting of findings .was essential if they were to be useful In 
decision making. Work on two literature review documents was delegated 
immediately. Dr. Kuno Belief is chairing a subgroup preparing a technical 
monograph reviewing all available research on early intervention, which is 
awaiting these dat:. for cctopletion. Dr. Frank Palmer pr.epared, a popular 
review of the e^^^indings which was wi^dely distributed in 1976. In 
June of 1977 he prepared a new review, presently being edited for publication, 
for the White House Commission on Mental Health. Dr. Bernard Brown 
successfully a^-ranged for presentations by Consortium members and staff at 
major professional meetings across the country in 1976 and 1977 (See 
Appendix A~3) . Over a thousand copies of a preliminary, non-technical 
report prepared in May»1977 for an OCD meeting in El Paso, Texas have been 
distributed in response to requests from state and federal agencies, school 
districts. Head Start sponsors and universities across the country. 

Substantial coverage by newspapers and ^newsletters has already occurred, 
and the Consortium chairman and staff have made presentations of the data 
to staff at the \^ite House, in the Congress, and to vario.us Head Start 
and day care groups. Articles have he^n scheduled in several major 
publications, and a summary of this report will appear in the widely 
read publication of The American Educational Research Association, 
The Educational Researcher. ^ 
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; If suppc^rt for further multivariate analyses becomes available, 
dissemination of those findings will be underwritten by a grant from the ^ 
Hewlett Foundation. 

Additionally, the individual investigators will be publishing 
findings unique to their own studies, using data beyond the cotnSbn core 
gathered by all the Consortium members • 

A "popular" summary of this report is being prepared 
for distribution to state legislators and governors, and a slide/sound 
presentation of the data will be produced for loan to local groups. 

A series of supplemental studies on special topics is planned to 
reach specialized audiences this fall and winter. Several doctoral dis- 
sertations are being drawn from these data, and will lead to additional 
publications. Consortium nembers have allowed themselves to be drafted 
for public and professional presentations, and a frequc-^.t use of telephones, 
air-package delivery, and finding ways to get together has kept the 
members reasonably abreast of feach other'fS work. \ 

Just as the data of ^ch ytudy remains the "property" of its principal 
investigator, so too has the independence of each investigatbr to publish 
and interpret the data in his/her own way been carefully preserved. Inter- 
pretations in this tlocument are those of the Chairman and the staff, althougt 
the membership will be asked to reviaw Che document before its delivery 
to our sponsors. 

The Consortium s/orked, we think, because its membership were 
personally secure, mature and well established scientists who respect 
each other, and were willing to forego personal goals in a genuine 
effort to produce a socially as well as scientifically important study. 



Under such circumstances, decision making and implementation flowed 
_.from the Importanre of the task* Open knowledge of finances, difficulties, 

and '4imitations eliminated most problems^ of ralsund^^s?^ndlng. The few 
' possible sources of conflict were quickly -brought to gV<uiE^^discussion, ^ 

despite the discomfort of such discussions. We believe that these 

practices, plus the character of the Investigators, made this project 

possible. 

E. Problems of Secondary Analysis 

This report essentially constitutes a secondary analysis of the 
data from the Consortium members' projects. 'This is true even thougli the 
1976-77 data were collected specifically for this report, since the 
design of the projects had been determined prior to the collection of 
these data. 

The most basic problem of secondary analysis in general is that the 
analysis uses data in a manner for which they were not originally intended. 
A prime example of this occurrence is the importance of the Stanford- 
Blnet scores in the current analysis. The Binet was(used by the original 
projects as one, of many measures of program effectiveness. However, 
since the Binet was' the test used by more projects than any other (in 
fact, other than the Peabody Picture Vocabulary Test it was the only test 
used by a majority of projects), it assumes a much greater importance 

in the current analysis that it had in the original analyses by the 

I. 

projects. 

A second problem of secondary research is that the questions which 
can be posed are limited by- the data which have already been collected. 
One simply cannot ask whether early education affects second grade IQ 



scores unless the projects gave IQ tests at that time. This problem 
is made* more complex by the fact that the projects were conducted in- 
dependently and, hence, the chances are slim that most projects would 
have i.ndependently collected the same measure at the same time (in fact, 
this happened only for the Mnet and Peabody Picture Vocabul '•y Test.) 

A third major problem is that the experimental designs were dif- 

/ 

ferent (par Licularly with respect to selection and assignment of program 
and control children) and tfiat, hence, comparisons of the studies are^ 
always tenuous. A secondary analysis does not give as directly useful 
information as would a carefully designed experiment of the same size. 
(An analysis of the sample selection and assignment procedures used by 
each project is contained iu Appendix B-10 

F . P roblems I^o^l^ itnH jnal^ Ana! ysjj^^ 

Since this report follows the same subjects over a number of years, 

it is also subject to the problems involved in longitudinal research. 

The most basic problem in longitudinal research is that of attrition, 
i.e,, the loss of subjects over time due to death, inability to be located, 
refusal to participate any longer, etc. This loss of subjects is only 
a minor problem if tiiC loss Is random, i.e., if there is no factor which 
causes the dropouts to be systematically different from the final sample^. 
However, tho rrsul rs of resenrch can be biased if one of three types 
of attrition occur:.. 

- the dropouts differ from the f lunl sample on some important 

ctiaracter ist i c (e.g., if cliildren witli less educated parents tended 
to drop out while those wHh more educated parents tended to stay 
In the fiuai sample). 
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- differential attrition between groups - if tlije pattern of attrit^ 

differed between the program and control groups (e.g., if the 

children with less educated parents were those who dropped out of 

the control group, while the children with more educated parents 

tended to drop out of the program group) . . 

> > * 

- differential attrition due to refusals to participate- by unhapp> 

or dissatisfied subjects. ' ' 

The overall evidence in our study seems to indicate that, although 

there are some instances of differential attrition,* the final samples 
« * 

are representative of the original samples. Overall 
there were no significant differences "between the demographic ' 
characteristics of those subjecti found and those not found. The only 
significant attrition dependeti^n whether specific pieces of 'data 
were in hand^on July 1, 1977. Thus, attrition appears to have been a 
fairly random process. This conclusion is not surprising given the 
fact that much of the attrition occurred whil^ neither program nor 
control children were receiving any major benefits ^or costs) from the 
project (i.e.', after project {-ermination) ! The major reason to 
suspect biases caused by attrition is that the benefits received from 
the pro^^am will cause a dif feren't pattern of attrition in the program 
versus control groups. Since the current Tollow-up occurred several 
years after program termination, there is little raason to^suspect that 
differential patterns of attrition would occur when neither group was 
receiving benefits from the program. The most crucial' period for 
which attrition must be investigated in evaluation research is the 
period of program duration - and the question of attrition during the 
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program has been addressed by most of the proje^t§ in their original 
reports which de^ with more immediate posttests. The fact that 
less than 3% (N=22) of the parents and/or youths contacted refused to 
participate in the follow-up eliminat^^ any concerns we had aJ)out 
contemporaneous differential attrition. The detailed attrition 
analysis i^contained in Appendix B-tJ. ' 

A second problem' in longitudinalfresearch- is 'that the^ measures 

«k * , 

used can: change in meaning over tim^- This is especially true of IQ 

and achievemeat tests since both the content and t>^*^' standardization 
change with age. The content of a test used to measure the IQ of ^a. 
seventeen ye^r^id" pbviously differs from ^the content, of a test used to 
measure "the IQ of a three year old. Given such differences, it takes 
a. tremendous leap' of faith in the infallibility of the test designers 
to say that an IQ of 100 at age seventeen is "the same as" an IQ of 100 
at age three. This problei]^ is further complicated by the fact that IQ 
and achievement tests are standardized cross-sectionally (e.g,, IQ at age 
*three is standardized on a group of three year olds, IQ at age four Von \ 
a different group of four year olds, .etc.) rather than longitudlrially 
(e.g., IQ at age three .being standardized on a group of three year oids, 
IQ at age four on the same group when thay turn four, etc.). Cross- 
sectional standard Lzat ion requires the additional leap of faith that the 
group of three year olds is "the same as" the grtftip of four year olds. 
To avoid these dif f ic^iotles , this analysis always considers IQ scores of 
the. program children as compared only with the IQ scores of a control^ 
group. The posttr.st of the pro^rart group is never compared to their 
pretest as an Lndicator of whether they gained in IQ. Rather, the program 

3.9 



children are said to have gained in IQ only if c.iey have gained relative _ 
to their control group** 

A third problem in longitudinal analysis is that of test-retest 
effects, i^e*, the fact that the very act of taking a first test mflv affect 
the scores of the s^econd test* Again, this effect Us controlled for 
to a certain extent in this report by comparing the program children only 
to their controls and not comparing program postest with program pre- 
test as an indicator cf success* (This method controls only in those 
instances in which the control children were- also given pretests; however, 
this did occur in most projects*) 

Qvei-v iew of the Analysis . 
Data for this study were collected in two stages. First, the original 
data ,collected independently by the projects were duplicaterl and sent to 
the. central office. This original data consisted of any IQ, achievement 
or other Vsycbological test data plus such demographic data a'te were col- 
lected by the projects* Second, ea^n project collected current-year 
follow-up da|:a in 1977 consisting of a standard parent interview, 
youth interview, school record data, achievement, test data and WISC-R 
IQ data. The interviews and data collection foims were developed 
by the Consortium s.nd were utilized by all but one project in this follow- 

up. ' 

^'Vhe analyses ct)ntained in tnis report are based on the Stanford- 
Binet- IQ test scores (from the original data), the WISC-R TO scores. 

* We recognize that, this is a more conservative standard than is consid^^red 
necessary bjr many psychometricians* Throughout this study we bav^ 
selected ^the' more conservative of alternative data treatment choifes, 
*so as to avoid debates which are rfot* germane to the principal problems 
b^eing investigated. 




If-/ 



Indicators of assignment to Special Education and of. grade fal.' :re from 
the school records, plus selected variables from the youth aad parent 
Interviews (from the ci^rrent follow-up data) . The status of the other 
'tiata collected in this project is contained in Appendix Data collected 

\. . and jQOt ^reporten ±ii this *paper .either ^arr:Jved too late for inclusion 
"t-^:^^ and will be included in later an^lys^iS, or have not yet been analyzed. 
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PART II 

• DATA COLLECTION METHODOLOGY 

II. Data Collection Methodology 

•qentral data collection me ..odology is described in this section. 
More specific information on the follow up data collection methodology 
(response rates, interviewer characteristics, etc.) is contained in , . 
Appendix B-2. . T!)e methods used in the variour analyses are contained^ 
in the analysis sections. 
A. Original Data 

The **orig; ' data" consists of data on individual children col- 
lected by the projec prior to their becoming invc .ved in the Consortium. 
Raw test and demographic data were duplicated at each project and transferred 
to the Central Office. Five projects (Beller, Lavenstein, Miller, 
Weikart-Carnegie and Zigler) transferred all data cn Hollerith cards. 
Six projects (Deutsch, Gordon, Karnes, Palmer, WeiV^rt-Ferry and Weikart 
Curriculum Demonstration) transferred most data on Hollerith cards plus 
soir.s data (generally demogra> ic information never before coded) on raw 
data sheets. Two projects (Giray ETP and Gray FOHV) transmitted all data 
on raw data sheets. D^ta from the raw daLa sheets were coded an key- 
punched at Cornell. All data were then checked for accuracy and internal 
consistency ari, where necessary, corrected after consultation with 
personnel at the project from which they came. Crosstabulations of type 
of data by project were performed to select those variable^ which were 
collected by enough projects to be selected for common analyses. Based 
on the results of these analyses, the Stanf ord-Binet IQ scores plus selected 
demographfc data were transformed to a common format and placed on a 
single SPSS file. In addition, separate SPSS files for each project 
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containing essentially all data received were created. 

For purposes of these analyses a case was defined as any subject 
whose test*8core was transmitted to the central office./ In some instances, 
this definition varies slightly from the definition of a case used 
•by the original projects, producing minor differences in the reported N's. 

B, Follow-up Data 

The decisions on the choice of common instruments to used 
in the present follow-up study evol\'6d from lengthy discussion of alternative: 
by the Consortium n.2mbers which lasted for over six muaLhs. Becausf of 
financial restrictions and the high cost pf locating subjects who had not 
boen inter>/iewed or tested for many years, it was necessary to -hoose a 
limited battery of mecisurements. The Consortium agreed to administer the 
age-appropriate Wechslet' Intelligence Scale and the Consortium- 
developed Parent and Youth Interviews, and to obtain data from the 

.chievement tes.ts administered by the schools as well as data from 

the school records. (See Appendix B-6, "Instruments" . )\ 

I . Parent and Youth Interviews / 

The Developmental Continuity Parent Interview was initially 

developed from a compilation of interviews used by individual investigators, 

/ 

especially those of David Weikart and Martin Deutsch,/ The interview 
was pretested twice; the second pretest ised a carefully controlled 
design which included families of children who hdd^attended Head Start in 
Ithaca, New York, or had participated in a home-based parent education 
program based in Norwich, New York, from two to ten years earlier. 
The pretest Simple parents were representative of the actual sample to 
be interviewed on such variables as race, urban/rural status, and number 
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of years since their child had been in the program.* 

The Parent Interview was designed to obtain comprehensive . information 
on househoid-Jcompositiori', socio-economic status, parental attitudes 
"toward, 'aspirations for, and evaluations of their child, information on 
the child's medical history, school educational history the parent 's 
current relationship with the child, and parental assessment of the 
intervention program. ^ 

The Youth Interview also drew upon previously developed interviews 
used by ll principal investigators, but it leaned ^ore heavily upon items 
of salient interest to participants at several Conscrtium meetings. 
This interview was also revised and pretexted in ,fcfte manner of the 
Parent Interview. v 

The Youth Interview obtains information on the child's status in school, 
Ji.is editcational and occupational aspirations, leisure time activities and 
interests, emplcyr.;ent status, and integration into his peer group and 

the larger community. 

The ir terviewing, whirb had begun in October, 1976 for Rome sites, was 
completed by most sites before July 1 1977. ^Two sites which were delayed fo 
fa variety of reasons (princioally the problems associated with getting 
school records data) will complete their interviewing and testing this 
summer. As of August 15, 1977, 958 Parent and 910 Youth Interviews had been 
completed and sont to Cornell. It is expected that the total number 
of each type will exceed 1,200. 



* None of the studies took place in upstate New York, and these sites 

were not included in this study except for pretests of the interview 

forms. Pretest interviewers and subjects varied in ethnic .group 

'membership. 
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All project sites experienced some difficulties locating their 
subjects after so many years. Various methods were used. Some projects 
began with name and address lists, both old and current, provided by 
local schools and Boards of Education (with elaborate procedures to insure 
informed consent by parents prior to the release of information). Other 
sites had maintained contact over the years through home visits, Christmas 
cards and post office forwarding addresses. Recently retired school 
teachers who lived in the community were a valuable source of the families 
current addresses. Meet sites contacted relations or friends of the 
families or asked the located parents about other families who were dif- 
ficult to contact. 

2. Wechsler Intelligence Scales 

The Wechsler scores (WISC, WISC-R and WAIS) were sent to 
Cornell in a common format on coding sheets. A total of 725 Wechsler 
scores were received from seven proiect sites. Five projects (Gray, 
Karnes, Miller, Palmer and Woolman) adtn'inistcred WISC-R' s during 1977 
and sent them to Cornell for the final report. The Palmer project sent 
additional WISC-R scores which had been collected during 1976, and the 
WISC-R*s sent for Gray's ETP group were administered in 1975. The 
Levenstein project sent WISC scores collected during the current year, 
while the Perry proiect sent WISC scores collected when the subjects 
were in ei^liLh p,r<iJc. (Since the Perry project consisted of five 
cohorts of children, it was ^decided that it was I'-^est to send test 
scores from a point wIrmi all children were the same ap.e rather than 
from the current year.) In the remaining sites, WISC testing was not 
completed in time fov inclusion in this report. 



3. School Record Forms 

For the October NERA meeting', Cornell staff developed an 
instrument for collecting school characteristics and student performance 
(marks, attendance, iiscipline). After Consortium members expressed 
concern about the time and money involved in collecting this data for 
every grade, the decision was made to develop a short form to be used by 
all sites and an optional long form. The .School Record Form (face 
sheets, short form) provided data on the most critical variables: 
current status in school, placement in special education, retention 
history, or accelerated experiences. In addition, school identificati<^ ^ 
by code number, location anci type was collected so that school variables 
such as funding level, staffing, and ethnicity, for example, could be 
investigated through secondary sources at a later date. Each site 
agreed to provide school and acliievement test data for four years 
v(the latest available year and three other specified years) rather 
than every year. Information about the School Record Supplement is 
contained in Appendix B-2. 

Most of the data on assignment to special education- and on failure 
in grade were transferred by the staff .of the individual investigators 
from the school records onto the School Record Form designed for use by 
all the projects. In some cases, however, the investigators had 
already collected such data from the school recl^ds in a different 
format, and these data were used in the analysis. 

The sources of the data used in the special education and grade 
retention analyses are listed below. 
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- For Gordon's project, the analyzed data on special education and 
retention contained in the report "School Performance as a 
Function of Early Stimulation'' were used* 

- For Gray's, Karnes', Miller's, and Woolman's projects, the raw 
data on special education and retention from the School Record 
Form were used, 

- For Levenstein's project, the raw data on special education snd 
retention collected from school teachers' reports on the children, 
were used. 

- For Palmer's project, the analyzed data on retention from the 
paper "The Effects of Early Childhood Intervention" wt.e used, 

- For Weikart's project, raw^data from fourth grade collected on 
c their forms were transcribed to the School Record Form, 

- For Zigler's project, the raw data on retention collected in a 
different format were used. 

Since some of the projects collected data Oii other than the School 
Record Form, the definition of "special education" varies somewhat across 
projects. The School Record Form itself provided four categories which 
are considered as special education for this analysis: special education 
(unspecified); educable mentally retarded or trainable mentally retarded; 
emotionally disturbed; and learning disabled classes, Irie definitions 
used, by proi^H-t, are as follow^:* 

- Cordon: Educable mentally r-tarded, trainable n^cntally retarded 

Specific learning disabled, emotionally disturbed 
^ (;i^jy: Kdiicahic mentally retarded, trainable mentally retarded 



Speech and hearing classes were not included in the definition of 
special education since many of the problems which could cause 
assignment to sucli classes are not susceptible to remeciiaulon by 
education pr><jccts. . 

4 { 
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- Karnes: 



- Levenstein: 



- Miller: 



- Woolman: 



- Weikart: 



Special education (undefined), oducable mentally retarded. 
Trainable mentally retarded, learning disabled, 
emotionally disturbed 

Educable mentally retarded, ^OCES, learning disabled. 

remedial reading, remedial math, bilingual 

Special education (undefined), educable mentally retarded^, 

trainable mentally retarded, learning disabled, emotionally 

disturbed 

Special education (undefined), educable mentally retarded, 
trainable mentally retarded, learning disabled, 
emotionally disturbed 
Special education (undefined) 



* A few children in bilingual classes were listed as being in special 
classes. 
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PART III 

COMPARISON OF SAMPLES ACROSS PROJECTS 

I' 

All projects in this study claimed to serve *Misadvantaged*V 
childran. However, an obvious question which arises is this: to what 
extent does "disadvantaged" mean the same thine across proiects? , ^ 
More precisely, were the children in one project comparable to the 
children in other projects? This question can be approached in two 
ways. First, the children in the projects can be comjpared on 
v^gggus measures to see if there are significant dl,ffcrcnccs across 
projects. Secondly, the procedures and criteria for sample selection 
of each pr..'ject can Ije analyzed. The first approach is dealt with 
in this section; tte second in Appendix B~l. * 

The children in the different projects were compared on three 
measures (all collected at the onset of the projects): pretest 
Stanford-Binet I.Q., mother's education, and head of household SES 
(Hollingshead ISP), One way ANOVA was performed for each of the three 
variables, using project as the grouping variable. Each ANOVA was 
performed separtely on two samples: the original sample (i.e., at the 
beginning of the projects) and the current follow-^up sample. Thus, a 
total of six ANOVA were run. Following ANOVA, the Scheffc procedure was 
used to divide the projects into homogeneous subsets (i.e., groups of 
projects ariion^; whom there were no significant differences). 

Table 2 reports the results of the ANOVA^s on pretest I.Q. for 
both the original and fullow-up aamplea. In uot\\ <^a5es there were 
significant differences among the projects. As seen in Figure 1, 
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there were no significant differences for the original sample among 
the Miller, Karnes, Palmer, Levenstein, Deutsch, Beller or Gray pro- 
jects. The Perry project was significantly lower in I.Q. than any 
other project except for CD, while the CD project was significantly 
lower than three of the other projects. Thus, the two projects which ^ 
had specified a maximum I.Q. of 84 as a criterion for entrance 
(see Appendix B-1) had, as expected, the lowest IQ. As seen in 
Figure 2, the Perry project was significantly lower than all other 
projects for the follow-up sample and there wore no significant 
differences among any of the other projects. 

r 

Tabic 3 reports the results of the ANOVA's on mother^s education 
for both the original and follow-up samples. Again, the differences 
were significant. Figure 3 shows the groupings for the original 
sample, with Palmer's project having the highest mother's education 
(significantly higher than Deutsch, Karnes, Perry and ETP) and Perry 
and ETP having the lowest mother's education (significantly lower 
than Palmer, Ziglcr and Miller). Figure 4 shows the groupings for 
the follow-up data, with Palmer and Miller significantly 
higher than V/eikart and Cray. 

Table 4 shows significant differences in the ANOVA's in SES for 
both samples. Figure 5 shows that for the original samples. Palmer 

is significantly higher than six of the nine other oroiects, while 
Perry and ETP are significantly lowet than Miller and Palmer,, Other- 
wise the projects arc homogeneous. Figure 6 shows that Palmer is 
significantly higlier than all other projects in the follow-up samples 
;ind that Miliar is ^: i >'.i) i T i caiU I y liiglicr than Weiknrt and Cray. 
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In sum the analyses show that there are some significant differences 
among the projects on pretest IQ, mother's education and SES, However, 
the analyses also show that there arj basically one or two projects In 
which the samples are significantly different than the rest, while the 
balance of the projects are homogeneous, -^he Perry^ and CD projects - 
are lower In IQ than the others duetto their maximum 10 criterion. 
The Palmer and Miller projects are generallyv the highest In mother's 
education and SES, while the Perry and ETP projects are lowest. Thus, 
In general, the children in the different projects are very similar 
on these measures. However^ the differences which have been, pointed 
out, particularly those of the Perry, Palmer, CD and ETP projects, 
should be kept in mind wh^n evaluating the results of analyses. 

Several words of caution should be addeu at this point. First, 
the measures used, of course, can give only a rough reflection of the 
true differences among the children. These measures do not reflect 
such crucial differences as the fact that, for Instance, children in 
the ETP project grev up in Murfreesboro, Tennessee, in the early 60's, 
while children in the Palmer project ^w up in Harlem in the late 60' s. 
Although the ETP, Karnes, Perry and CD projects administered full Binet 
pretests to their entire samples, Levenstein admin Lslered a Blnet 
pretest to only about 20% of her sample (others were given the Cattel) 
and Palmer administered a pretest to only 60% of his sample (thoae who 
began preschool at age two were not pretested). Miller did not 
administer "pretests" to her experimentals until ihey had already been 
in the programs for two to- three months. Given the evidence that 
.preschool significantly increases children's IQ's within the first 
three months, therefore, it is likely that the programs had already 
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increased t]}? children's IQ's by the time they were ''pretested. 
Their true pretest scores ^*%ld probably have been several paints 

Hower, and the "pretest" scores reported cannot validly be compared 

either with control pretests or with pretests for experimentals from ^ 

other projects.* FurtiTermore, since neither Gordon, Gray-FOHV, nor the 

Carnegie projects gave Binet pretests (as their children entered 

before age three)* these projects could not be included in this analysis. 

Thus, the analysis of the differences in pretest I.Q. scores applies 

only to a limited number of projects.. 



* This "late" administration of .he initial inlelligence test may account 
for some of the differences in findings for Miller's groups as compared 
to the findings for he .other studies. 

Wliile it is possible to convert Binet and other tests to standard 

scores in onlcr io IndiKle the other studies' pretest IQ's in this analysis, 

ve liave ag.'Un ('h(>hon the most conservative' ()pLlon. 
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Table 2; Comparison of Projects on Pretest 'Stanf ord-Binet_J[g 



^.Original Sample 





Mean I.Q. 


N 


Seller 


89-67 


168 




90,85 ' 


930" 






0^ 


Grav ETP 


88.39' 


88 


Gray FOHV 




0 




92.30 


22A 


Levenstein 


91.18 


45 ^ 


Miller 


92.37 




Palmer 


91.28 


183 


Weikart-Perry 


79.02 


123 


Weikart-CB 


80.56 


41 


Weikart -Carnegie 




A 
U 


Woolman 




0 • 


Zigler 




0 


average 


90.12 




overall F 


10.57 




significance 


< .01 





FoIIow-up Sample 



Mean I.Q. 
92.58 

92.43 



88.19 

94.73' 
92.05 
93.17 
' 92.21 
7-9.02 



90.25 
11.854 
< .01 



N 
86 

54 

(0 



0 

122 
"21 

127 
131 
123 
0 

^ 0 
0 
-0 
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.Figure 1^ 



"komogeneotts^ Groups of Projects * 
on Pretest Sranford-Blnet IQ 
for the Original Sample 




/iniiiM unnT 



Figure 2 

4 

Homogeneous Groups of Pro jects* 
"o n Pretest Suanford-Blnet £Q , 
for the Follow-up Sample 




* within each circle 
(Venn dlap:ram), there 
Is no «?lgnlf leant 
difference in IQ among 
the p^'rojects according 
to the Scheffe' test ' 



Table 3: 


Comparison of Projects 


on Mothers' Education 




Original Sample 


Follow- 


•up Sample 


Mean*«Grades Completed N 


'Mean Gradss Completed N 


Beller 


0 




0 


Deutsch 


10.14 164 


10.09 


44 


Gr ':yv 


b 

10.49 115 


10.68' 


37 


Gray hii^ 


9.13' 88 


9.28 


75 


Gray FOHV 
Karnes 


10.18 49 
10.11 20C 


— - 
10.08 


0 

118 


Levenstein 


10.51 248 


10.53 


185 


Miller 


10.82 227 


3^.79 


1'. 


Palmer 


11.'23 299 


. 11.14' 


219 


Weikart-Perry 


9.42 123 


9.42 


123 




10.34 41 


• 


0 


Weikart-Carnegie 


10.71^ 56 




0 


Woolman 


o 0 




0 


•Zigler 


1J<07 97 




0 


average 


10. 4^ 
Il.431 


10.38 




overall F 


6.995 




significance 


< .01 


<.01 
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'^ Homogeneous Groups of Projects^ 
on Mother's Ed'ucat:ion 
for the Original Sample 




Figure 4 

Homogeneous Groups of Projects^ 
on Mother's Education 
for the Follow-up Sample 




highest 

education group 
middle 

education group 



^^ithin each circle (Venn diagram), 
there is no significant difference 
in mother's education among the 
prv^jects according to the Scheffe 
test. 



educ: 



lowest 



aticn group 
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T;.ble 4: Comp^>-^«nn of Projects on H ead_pJ_JLoji^^^^^^ SES, 



Original Sample 



Follow-up Sample 



Proiect ^^^^ 


N 


mean i-i> 


Beller ' 





0 




Deutsch 


65.94 


163 


64 .88 


Gordon 


63. '7 


10,*^ 


64,18 


Gray IT? 


6' 


82 


69.67 


Gray FOHV 


66.41 


46 




Karnes 


64.76 


193 


^ C OA 

65.30 


Levensteln 


64.94 


247 


64. 76 


Millei- 


63.15 


170 


63.46 


Palmer 


58.17 


295 


59.18 


Welkart-Perry 


68.48 


122 


68.48 


Weikkrt-CD 


64. J4 


41 




Weikart-Carnegie 




0 




Woolmar 




0 




Zigler 




0 





• N 
0 

*43 
34 
70 

0 

114 
184 
94 
216 
122 
0 
0 
0 
0 



average 63.95 
OV3 rail F 14.132 
significance ^ .01 



64.21 

9.074 
< .01 
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Figure 5 

Homogeneous Groups of Projerts * 
on Socio-economic Status 
for the Original Sample 



Diriiif 



[highest SES 
'group 

^middle ShS 
"group 

lowest SES 
J group 





Palmer 






Miller 






222T 




JH^ Cordon 



Weikart--CD 



Karnes Levenstein ^ 

^Deutsch Gray-FOHV 
Weikar t-Perry 
Gray-ETP 

^1 H \ 11 V k I I ^ I \ 1 n-r: 

Figure 6 

Homogeneous Groups of Projects * 
on Socio-economic Status 
for the Follow-up Sample 





Miller 



n f t'l M I I I 1 M I cm 

Gordon Levenstein 



i 



^ Deutsch Karnes ^ 

We ikar t-I er r y 



Gr ay- ETP 




Within each circle (Venn 
Diagram) , there is no 
significant difference in 
SES among the projects 
according to the Scheffe' 
test. 
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PART IV. 



ANALYSIS OF PROGRAM AND CONTROL D?vFFERENCES 
IK COGNITIVE FUNCTIONir.G 



The first question on* is inclined to ask when presented with the 



body of data collected by this project is this: overall, does the 
evidence indicate that early education improves the academic performance 
of low income children?* The fact that this report is a secondary 
analysis of independently conducted research efforts limits tl^e rigor 
with which this (or any other) question can be addressed by this body 
of data* These data, however, contain better selected non-t*"eated 
controls than any other stud; of comparable size. Additionally, the 
fact that it would take two decades to collect equivalent longitudinal 
data makes these data perhaps the best available to answer questions 
of the\ef fectiveness of early education for low income children. 



Dili to the differences in sample assignment procedures, comparisons 
b'stween program and control are made for each project individually; 
data are not pooled across projects in this report. Rather, in order to 
evaluate the overall evidence, the significance levels from the 
individual project program-control comparisons are pooled using a 
standard statistical method. 



* All of the projects except the Perry Preschool and the Carnegie Infant 
Program compared variations of programs (eitner in terms of age at 
which the program was administered, or in terms of variations of the 
curriculum or apr-oach, or in terms of both). However, this analysis 
deals primarily with the effect of participating in a preschool program 
in the context of family variables and does not make a systematic at- 
tempt to distinguish among types of preschool approaches. Therefore, 
these variations are grouped together as "having received experimen^-al 
preschool education'^ and are contrasted only against controls who had 
not i^eceived such an education rathei than against each other. It 
must be remembered that this secondary analysis has purposes different 
from the original intent of these studies. 
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Of the data accumulated In usable form by the time of this report, ^ 
three bodies of data seemed particularly appropriate in answering the question 
of whether early education can produce academic benefits for low income 
children: the Stanf ord-Binet IQ data collected independently by most o£ the 
projects over a number of years; the WISC-R data collected priuarily as 
part of the current follow-up: and the school record data on assignment to 
special education and grade retention collected primarily as part of the cur- 
rent follow-up. The analysis .^ousists of three stages, with each stage 
corresponding to a particular .>oa/ of data. 

The first stage employs the Stanf ord-Binet TQ data to answer the 
question of whether the programs increased the mean IQ's of the children 
relative to a control group and, if so, for hov; long did these gains 
last? The question is addressed first by making simple comparisons (t- 
tests) of the mean posttest-IO scores of program and control groups for 
all available data points for each project. The significance levels for 
the comparisons are grouped by number of years after program terminaM'on 
and then pooled across proiecLs. This technique gives an indication 
of whether, given all available evidence, there is a significant dif- 
ference in IQ scores between program and control chiluren .1 given 
number of years after the program. Secondly, the procedure is repented 
while controlling for pretest IQ where available. This analysis serves 
primaril^as a check on the sample assignment procedures; of the projects. 

The 'second stage consists of nn analysis ol the WISC-R IQ data col- 
lected during the current (or previous) year for those projects which 
have reported it thus far. 'Hiis body of data constitutes the latest IQ 
data available and is useful primarily for addres. ng the question of 
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whether early education can produce long-term TQ score increases. 
I 

Since C;hese data were collected at widely different ages (ranging from ten 
to seventeen years), the analyses are reported indivuiually foi each 
project. Again, the analyses consist ofL.t-test comparisons of program 
and control group mean IQ's. 

The third and final stage consists of the analysis of whether the 
children were assigned to special education classes. or held back in grade* 
Crosstabulations of the number of children assigned to special education 
and of the number of children held back by program-control status are 
performed for each project and significance levels are pooled. This 
analysis indicates whether early education affects actual performance in 
school. The last section of Part IV discusses analysis of school related 
responses trom the Youth Interview. 

A . Analysis of Stanf ord-Binet IQ Scores from Immediate Posrtest to 
Three Years after Program Termination ^ 

The Stanford-Binet was chosen because it was the te^^ most commonly 

used by the Consortium projects and because it has had a fairly large 
scale standardization. In all projects the Binet was only one pf many 
tests used to evaluate the program. The Binet evaluates a Wide range 
of abilities, only a few of wl ich may have been the targets of a given 
project. Thus, the project could have achieved a significant improvement 
in the abilities toward which it was aimed without having evidenced a 
significant change in the Bjnet score, since the Binet also taps other 
abilities which the project had ot attempted to improve. A perusal 
of individual project reports reveals chat in many "instances the 
investigators found other tests to be more relevant than IQ to the 
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purposes of their -^'^ject. In fact these other tests often yielded more 
favorable results than the Binet. (Unfortunately, however, since such 
tests were more specific to the goals of each project, none of them 
was used by more than one or two projects; hence, they form a less 
solid basis for comparison of the projects^) 

In using the Binet as a uependent variable, this paper is employing 
a*very stringent criterion of success for these projects. Therefore 
a failure to improve the BineL IQ cannot be taken ^s a failure ^f* a 
program to accomplish its goals. On the other hand, the success 
of a project in improving IQ scores means that it has accompli. sheH 

at least one goal which our society deems important. 

This analysis is also adopting a conservative tactic by comparing 
only Binet iQ's Crathcr than comparing re^ylts on Binet, WlSC, Catcell 
and bther TQ tests) due to the problems inherent in comparing one IQ 
test with another. This approach results in the loss of early scores 
in the Gordon, FOHV, VU\ and Carnegie projects, as well as several 
follow-up testing poricxls in t!;e VIP project.* Problems of comparability 
across projects still occur because of differences in testing situations 
(e.g., differences duo to sex and race of tester, or extent of efforts 
to let the child ^'adjust'* to the testing situation). However, such dif- 
ferences are assumed to be negligible 'tinless otherwise noted in the text. 

IQ scores arc roported on the basis of the 1960 deviat ion IQ tables 
because these were tlK- scores reported by the individual projects. 



i< Separate later analyses may be undertaken at a later date in which sc 
from various tests uail he converted to standard scopes and compared. 

ii^ Non-psychometrist readers should be cautious in comparing these 
1960 IQ scores with Binet scores based on the 1972 standardization 
since they are not ider.tlcal at the earliest age levels* 
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For the purpose of comparing tescing periods across projocts, one 
testing period "slot" was created for every year of age (e.g., the first 
slot ranged from eighteen to .twenty-nine months, the midpoint being 
twenty-four months, :etcO\* The testing periods were then -assigned to 
the slots in wh'ich their mean chronological age fell. For example, any 
testing period with a mean chronological age between chirty and forty- 
one months would be compared with any pther projects' testing periods . 
where the mesn chronological age was between thirty and forty-one months. 
This procedure ensures that only tests which were given at approxi:aateiy 
the same ages are compared with each other and minimizes the aee bias 
built into this test,** 

The available Binet data allo,^ one to evaluate the effects of pre- 
school on IQ test tjcores up to three years after children have lef l the 
program."^ Table ^ gives the reisults of the simple t-test comparisons of 
mean posttest Stanford-Binet IQ scores ior the program and control 
<>roups for each project. With only two exceptions (Miller at ages 
seven and eight), the mean IQ ok the program groups is higner than the 



* Thus, all children in cae project's testing period were always placed 
in the same slot. This procedure might seem too obvious to mention; 
however, specification of the procedure was necessary because some 
projects defined testing period by chronological age regardless of 
time in the school year, while others defined testing period by time 
of the school year (e.g., post first grade). 

An alternative procedure would have been to define testing period 
slots by number of years after the termination of the preschool; 
however, this would have entailed comparing IQ across different 
ages and this poses other problems.;^— 

*^ Karnes and Miller have administered both the Binct and WISC-R to 
samples of the 1977 follow-up group. The new Binet data did not 
arrive in time for this report, but may he treated and reported 
separately later this year. 
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mean IQ of the cHitrol group. When the significance levels are grouped 
by length of time after the termination of the program* and are pooled 
using the technique recommended by Darlington** (as shown in Table 6), 
the evidence shows that early education can produce significant increases 
in IQ (over a control group) v>fhich last for up to three years after the 
child leaves the program. The pooled z scores are significant for the 
immediate posttes'c and for the one, two, and three years after posttests. 
Thus, the evidence from simple t-tests suggests that early educar.ion can 
indeed increase IQ scores and that these'^gains last for at least several 
years. One should note from lable 5, however, that for most proiects, 
while the diffrronce in TQ scores between program and control groups 
decreases over time, it does not decrease as immediately ss had been 
previously asserted by rritirs of early intervention. 

The next quest icMi which must be asked is this: does Hie effect of early 
intervention on li] remain after one has controlled for the influence of 
pretest TQ scores? This question is essentially an evaluation of the 
sample assignmeiiL proci dur.>s . If the procedures functioned to Insure an 



The significance Levels were grouped by number of years after the 
termination of the program rather than by age for two reasons: 
first, Lf one pooled by age, it would entail poolin>^ the results of 
immediate post-tests with those of later follow-up tests (which 
would lead to inaccurate inference due to tlie "fadeout" effect often 
observed In preschool programs for low income children) and second, 
the technique of pooling only significance levels circumvents the 
prol'lem of comparing IQ tests across ages. Furthermore, analyzing^ 
by the number of years after program termination answers the question 
of how long the effects last as opposed to the question of to what 
age the effects last. 

Richard Datlington, Had i£al_s ancj^ Sja^^^ Logan Hill Press, Ithaca, NY', 
1975, p. 52S. 
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initial equivalency between groups i^ IQ scores, then the procedure of 
controlling for initial IQ will yield essentially the same results as 
would a simple t-test. To control for pretest IQ, the pretest Binet 
(or in the case of Levenstein, PPVT) IQ scores are introduced, along 
with program-control status, into a multiple' regression equation 



determining posttest IQ. The equation used is as follows:* 

IQ = PC + IQ + (IQ> ^ 

posttest pretest pretest 



where PC = 1 for program children 
PC = 0 for control children 

The regression equation was run for each project for each post- 
test. The regression coefficient for the early education variable gives 
the difference in IQ points between program and control groups after 
controlling for the pretest. The significance of this coefficient tells 
whether the program had a significant effect on IQ after controlling for 
the effect of prior IQ. Hence, comparing the significance of the regression 
coefficient to the significance of the t-test shows whether controlling 

^ , , , t ^ ill -1. _ e ^ *-U/-» *- r\ct- C 

about the effect of early education IQ. 

This procedure cannot be carried out for all projects. Gordon, FOHV, 
and Carne^ did not give Stanf ord-Binet or PPVT pretests. Their children 
entered at too young an age for these tests and, hence, were given 
infant tests. Palmer pretested only half of his program group, and his 
control group was pretested at an average age of two years, eight months. 



* Both pretest IQ and pretest IQ squared are introduced into the equation 
in order to allow for a nonlinear relationship between pretest and post- 
test (i.e., to allow the line graphing the relationship to curve at some 
point) and thus provide a more unbiased estimator of the effect of pre- 
school. 



while the program group was pretested at an average age- of three years. 
Given the fact that two years of age is the very earliest the Binet^ 
can be given, plus the fact that the longitudinal standardization of 
IQ tests is questionable (see Methodology), the four months average 
difference could bias the pretest scores in a direction unfavorable to 
the hypothesis that the program would have long-term effects. As 
already mentioned (see Methodology), Miller did net administer 
•'pretests'' to her program children until they had already been in the 
program for two to three months. Thus, there appear to exist biases 
ii^ bo'th the Miller and Palmer projects which would bias results in 
favor of the itrols when pretest IQ is entere'' into the equation. 

Table 7 compares the significance of the regression coefficients 
with the significance of the t-tests in all cases where pretests were 
reported. As can be seen, there was no change in significance in 
twenty out of the twenty-seven comparison.^. In five cases, the 
regression coefficient was not significant where the t-test had been. 
However, two of these cases were from the Palmer project, for which 
the comparison of prop,ram and control, while controlling for pretest, 
may not be valid. Of the other two cases which showed a f^hange in 
significance, one (Miller at age eight) was another case where 
controlling for pVetest may not be valid, while the other (Levenstein 
at a\\c five) nctually showed a difference whlrh became significant 
when the pretest was used as a controlling variable. 

Thus, there appear to he only three of twenty-seven comparisons 
where controlling for the pretest eliminates the significance of. the 
effect of early education on IQ. Moreovei in the two ETP comparisons, 
the regression coefficient was still quite close to the .05 
significance level (.H and .06). ^^-j 



In order to determine whether controlling for pretest IQ affects 
the pooled results that were reported in Table 6, the significance levels 
for the regression coefficients were, wherever available, substVtuted 
into the pooled z analysis. The results are shown in Table 8- (Table 8 
thus contains the significance levels for regression coefficients where 
available and the significance levels foi t-tests where the regression 
coefficients were unavailable). The results show that, although the 
pooled z's were somewhat reduced, there are still significant differences 
in IQ fojc up to three years- This is true ^^en though the regression 
coefficients for the Miller and Palmer projects (which presumably contain 
biases favoring the control groups as explained above) were included in ■ 
the analysis. While this procedure is noc as rigorous as one would have 
designed in a primary analysis, it does indicate that early education 
HnPQ have a significan^ ^nd lasting (fo r at least three year..^ effect 
on IQ . Other analyses conducted du.ir.g this project (see Harry Murray, 
"Eariy Intervention in the Context of Family Characteristics," and 
Virginia Ruth Hubbell. "Differential Effects of Early Childhood 
Intervention Programs," Appendix C) show that thls^conclusion_ also 
holds wht-n emit jr£U ing^ £ox ^fam^lx JJlviloSPenL^^^ • "^'^^ ' ' 

evidence thus serves to refute the notion that early education has only 
a very short-term impact on the IQ of low income children. 
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Table 5: Mean IQ's for Experimental and Control by Project 

Age Mean IQ Mean IQ t-value Significance « N 

ProRram Control ^ Pro^i^am Control 



Seller 



Dcutsch 



J 



Gordon 



Graf ETP 



Palmer 



Weikart- 
Perry 



Gray FOHV 



T.evenstein 



Miller 
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Wcikart- 
Cai;negie. 



Pr.e 
5 
6 
7 
8 
9 

5 ^ 

6 
7 
8 
9 

3 
A 

5. 
6 

Pre 

5 

6 

7 

8 
10 

3 
4 
3 

3 
■ A 
5 
6 

4 
5 
6 
7 
8 

3 
4 
5' 

Pre 
5 
6 
7 
8 
9 

10 

3 
6 

7 



92.16 
98.59 
98.36 
97.83 
97.61 
98.44 

100.24 
96.10 

9V.63 

94.88 
93.89 
94.02 
94.01 

89.43 
96.05 
94.98 
97.71 
•93.63 
88.42 

87.31' 

91.11 

91.(^3 

101. J4 
105.44 
107.07 
101.44 

- 92.87 
97. 33 
94.06 
'92.48 
.,89.72 

91.63 
97.74 
96.41 

79.57 
94.05 
■ 91.2,5 
91.72 
88.11 
87.71 
84.98 

1 04 . 10 
1 11.95 
106.40 



88.39 
88.39 
92.07 
>90.59 
9i ^3 
90.04 

92.08 
93.14 
93.00 



91.40 
88.47 
88.94 
85.69 

87.34 
86.12 
81.89 
89.56 
86.10 
81.17 

81.14 
83.88 
• 89.25 

92.72 
96.00 
103.17 
87.36 

89.21 
90.00 
93.74 
92.48 
94.00 

85.32 
93. 31 
91.13 

78.54 
83.20 
86. 34 
.S7.07 
86.85 
86.77 
84.61 

100.44 
109.47 
104.06 



1.93 
4.48 
2.69 
3.20 
3.10 
4.08 

5.82 
4.03 
0.78 



93.92 0.88 



1.82 
2.31 
2.38 
2.72 

0.74 
3.96 
5.30 
3.07 
2.47 
2.63 

1.42 
1.77 
0.36 

3.74 
3.94 
0.74 
2.12 

1.57 
3.27 
0.14 
0.00 
-1. 38 

3.05 
2.17 
2. .55 

0.89 
5.40 
2. "4 3 
2.32 
0.57 
0.43 
0.17 

0.82 
0. 52 
0.54 



.056 

.0001 

.008 

.002 

.002. 

.0001 

.0001 
.0001 
437 

386 

' .072 
.022 
.018 
.007 

.462 
.0001 
.0001 
-.003 
.016 
^010 

.162 
.083 . 
.724 

.0001 
.0001 
.462 
.060 

.117 
.001 
.891 
->999 , 
-.176 

.003 ' 

.031 

.011 

.378 

.0001 

.017 

.022 

.569 

.666 

.861 

.417 
.606 

6o 



57 
56 . 
53 
52 
51 
50 . 

260 
189 
31 

32 

144 . 
133 
i34 
127 

44 
47 
45 
41 
42 
• 42 

29 

35. 

32 

124, 
108 
97 
• 99 

213 
210 
200 
192 
174 

228 
221 
207 

65 
64 
64 
61 
62 
61 
57 

20 
19 
20 



111 
111 
110 
105 

99 

99 

142 
97 
21 

'12' - 
52 

52 

44 ^. 

4? 

42 

4X 
38 
3h 

14 
16 

29 
42 
6 
10 

34 
34 
31 
29 
29 

63 
59 
48 

58 
57 

58 
'56 
56 
57 

18 
17 
33 



s.- . 



->! 5- . 



Table 6: Compa ring Program and Control on Stanford-Blnei IQ Score - 
~ Tooled z^s and Si^tiiflcance for t-tests by Number of Years 

after Terminat io n of Early Education 

Wdlate Posttest One Year Af t^r Two Years After 3 or 4 Y^^^ 

^ score Significanc e z score Significance z score Significance z score Significance* 



1.69 



•1.32 
5.30 



my 



It- " 



iBelier 4,48 
Bteutsch 
Gordon 
Gr6.. 'TP 
Gray FOHV 1.42 
Levenstein 3.74 
Miller- 3.27 
Pslxoer 



Weikart- 
Perry 

Weiicart- 
Carnegie 



2.17 
5.40 



2 « 9.7b 
p .0000 



.0001 

.092 

.072 

.0001 

.162 

.0001 

.001 

.031 

.0001 



2.69 



.008 



3.20 



.002 



2.31 


n79 
<« u^z 


38 


.018 


2. .'6 


.003 


2.41„ 


.016 


1.73 


.033 


0.35 


.724 


0.73 


.462 


1.88 


.060 


0.14 


.891 


-0.00 


.999 


2.55 


.011 






2.39 


.017 


2.29 " 


.022 


0.81 


.417 






5.44 




4.', i 




.0000 




.0000 . 





4.08 



-1.38 

0.57 
0.52 

3.71 
. 0002 



.0001 



2.72 .007 

t 

2.58 • .010 



.176 

.569 
.606 



* All significance ,2vels ate two-cailed. 



69 



ERIC: 



VO 





-:>o- 



•■• liable 7: 



Com parison of t-test Results with Regression on Effect of Program 



Age 



Mean 

Difference 



Regression 
Coefficient 



t'-value t-value Signi- Significance 

t~test Regression flcance Preschool 
Coefficient t-test Regression 





:?fexier 


5 


10.20 




4.48 




.0001 
















6 


6.29 


4.23 


2.69 


2.59 


.008 


.0096 






7 


7.24 


5.08 


3.20 


3.36 


.002 


.0008 






8 


6.58 


3.60 


3.10 


2.28 


.002 


.0226 






9 


8. AO 


5.75 


4.08 


3.62 


.0001 


.0004 




Detstsch 


5 


7.53 


5.36 


7.81 


4.96 


.0001 


.0001 










1 51 


10.36 


2 .07 


.0001 


.0384 


MH - 




7 


6.58 




3.74 


NE 


.0001 


.99 






9 


4.98 


6.24 


1.70 


1.11 


.092 


.267 


^^-^ 
ft 


uray ^ i r 


5 


9.73 


7 .85 


3.96 


4.37 


.0001 


.0001 


w 




6 


13.09 


li.52 


5.30 


6.60 


.0001 


.0001 




7 


8.15 


6.29 


3.f^7 


2.80 


.003 


.0052 


it 




8 


7.53 


3.91 


2.' 7 


1.50 


:oi6 


.1336 


% 




10 


7.25 


4 -''4 


2.63 


l.b7 


.010 


.0614 




Levensteln 


3 


o • hZ 




3 74 




.0001 




m ^ 




A 


9.44 


7.94 


3.94 


:..36 


.0001 


.0008 






5 


3.90 


3.89 


0.74 


n.82 


.462 


.4122 


If- 




6 


14.14 


12.08 


2.12 


2.84 


.060 






Mi .Her 


5 


7.33 


4.81 


3.27 


3.05 


.001 


.0022 


k] 




6 


0.32 


-1.53 


-0.14 


-0.88 


.891 


-.3788 


1^ * 




7 


0.00 


2.80 


0.00 


-1.40 


.999 


-.1616 


- 




8 


-4.?8 


-6.76 


-1.38 


-3.31 


.176 


-.001 




Palmer 


3 


6 . 31 








.003 








A 


4.43 


-1.23 


<* 


M . 1 Z 


mi 


A71 






5 


5.28 


1.14 


2.55 


0.57 


.011 


.5686 




Perry 


5 


10.85 


10.47 


5.40 


5.54 


.0001 


.0001 






6 


4.91 


4.47 


2.43 


2.43 


.017 


.017 






7. 


4.65 


4.05 


2.32 


2.16 


.022 


.031 


f " ' 




8 


1.26 


1.16 


0.57 


0.55 


.'569 


.582 






9 


0.94 


0.70 


0.43 


0.35 


.667 


.726 






10 




■•i; 


0.17 




.865 


m; 



(I 



^^^^^^^^^ 



mi: 

5.'/-'" 



% 


Table 8: 


Pooled Z's 


«;,thQt-lt-iitinB in Regression Coefficient Where Available 






TrmnpH-IptP Post* 


1 Year After 


2 Years 


After 


3 cr 4 


Years After 


\ 


2 score 


Significance z score 


Significance 


z score 


Significance 


2 score 


Significance 


Beller 




.0001 


2.59 


0096"" 

. \J\J ^ V* ^ 


3.35 


.0008] 


3.55 




Deu»ch 

A 

Gordon 


1 • 11 


.267] 














1.82 


.072 


2.31 


099 


2.38 


.018 


2.72 


.007 


Gray ETP 


H.J/ 


.0001] 


2.80 


.0052] 


1.50 


.1336] 


1.87 


.061A] 


Gray FOHV 


1.42 


.162 


1.73 


• UO J 


0.35 


.724 






Levenstein 


3.36 


.0008] 


O.o2 


.4122] 


2.83 


.0046] 






Miller 


3.05 


.0022] 


-0.88 


-.3788] 


-1.40 


-.1616] 


-3.30 




Palmer 




.472] 


0.57 


.569] 




0 






Weikart-Perry 
Weikart-Carnegie 


• 5.54 
8.62 


•ooo^j. 


2.39 
0.81 
4.38 


.017] 
.417 


2.10 
4.22 


.031] 


0.55 
0.52 
2.41 


.582] 
.606 



] - significance and z score taken from repression 
All significance levels are two-tailed. 
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B. Analysis of WISC-R IQ Scores 

■ As part of the current follow-up, WISC-R IQ tests were administered 
by the projects. Seven projects have thus far reported results. Of 
these, six will be treated here. (The seventh, Karnes, has no untreated 
control group). Of the six, one (Woolijjan) will be discussed separately 
due to the nature of his control»-groups. 

■J 

Table 9 gives the t-test comparison of the mean IQ scores for the 
levenstein, Palmer, Miller, Perry and ETP projects. Figures are given 
for the three types of IQ scores available from the WISC-R: Full Scale IQ, 
Verbal IQ, and Performance IQ.* As can be seen there -re significant 
differences only for the two projects with younger childi^en. The 
FI'Q and VIQ are sU^nif icantly greater for the program group in the 
project with the you gest children (Levenstein), while only the PIQ 
is significantly greater in the cthr^r (Palmer). For the projects with 
children twelve years, eight months or older there is no significant 
difference between program and controls (although the Millar results in 
this respect may~again be'a function of the selection process used for 
the control group). Thus, the results from these projects indicate 
that the effect of early education on IQ, although shewn to be long 
term in rhe previous section, is probably not {)ermanent. Analysis of 
the WISC-R subtesc scores' does nothing to alter this conclusion. Only 
in the Levenstein project were the program children significantly higher 
then the controls on more than one subtest. It should be noted, however, 



* Each t^st is made up- of tcin to twelve subtests grouped intcf a verbal 
scale (VIQ) and a performance scale (PIQ), each winh fivo to s^ ' 
subtests. The full scale IQ (FTQ) is the sum of all subtests. 



in no instances were the controls significantly higher than the program 
children.* 

The Woolman project compared the program children to a random sampl 
of other children In their classrooms. Since the program children were 
originally selected by the school district as disadvanl aged , this 
comparison group would presum^l^ly be more advantaged. (The city of 
Vineland is not overwhelmingly poor. The 1970 Census reports 8.2% 
as being below Che low income level.) As shown in Table 9, there is 
no significant difference in IQ between the program children and the 
other children in their classrooms. Thus, the children, although 
Selected as the most disadvantaged by the school district, are not 
lower in IQ than the other children ir the classroom. ^ The children 
are an average of eleven years and three months .old . so these results 
also support the hypothesis of IQ increases which last for several 
years. 



* Exami'.ation of subtest score patterns may bo undertaken latc>r ihl.s 
year. 
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Table 


9: 


Comparison of 


Wise IQ' 


s by Pro 


ject 










Mean 


Mean IQ 






signi- 


M 


N 






Age 


Program 


Control 


Value 


ficance 


Program 


Control 


Levenst^iin 


FIQ 


9-9 




101.86 


93.56 


3.21 


.002 


51 . 


25 




VIQ 






• 98.41 


89.36 


3.66 


.0001 








"IQ 


9-9 




105.45 


99.48 


1.89 


.063 


51 


25 


Palmer 


FIO 


12- 


2 


92.31 


87.64 


1.65 


.102 


94 


25 




VIQ 


12- 


2 


93.33 


.92.20 


0.37 


.711 


94 






PIQ 




9 


92.71 


85.20 


2.53 . 


.013 


94 


25 . 


M-f'l 1 pr 

IIJ. ^Xd> 


FIO 


12- 


8 


84.96 


87.69 ' 


-1.13 


- .262 


109 


32 




VIQ 


12- 


8 


83.07 


85.53 


-0.96 


-.337 


109 


32 • 




PIQ 


1 9- 

iz— 


Q 
O 


89.42 


92,41 


-1.12 


-.263 


109 




rc t J. y 


FIO 


14- 


0 


81.02 


80, 71 


0.14 


.885 


54 






VIQ 


14- 


0 


78.33 


11 .bk 


0.36 


.721 


54 






PIQ 


14- 


0 


87.59 


87,82 


-0.10 


-.924 


54 


jC 


Hrav FTP 


FIO 


16- 


9 


78.74 


11 .1^ 


0.32 


.752 


34 


3« • 




V 


16- 


9 


77.09 




- 0 4Q 


- 6?4 


34 


3'< 




PIQ 


16- 


9 


83.41 


80.26 


1.02 


.310 


34 


38 


Woolman 


FIQ 


11- 


3 


91.15 


93.50 


-0.76 


-.451 


34 


40 






11- 


:5 


86.82 


91.33 


-1.31 


- .193 


34 


40 




PIQ 


11- 


3 


97.85 


97.38 


0.16 


.873 


34 


40 



* The control group measure is the mean IQ of the other children in the classrooms. 
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Summary of Results of the IQ Testing 

Taken as a wKole, the Stanf ord-Binet results from the original data 
and the WISC-R results from the current follow-up data refute two hypotheses: 

(a) the hypothesis that early education has only a short-lived 
effect on IQ scores (i.e., that such programs basically train 
children to take tests and that the effects fade quickly as soon 
as the children are removed from the program). 

(b) the hypothesis tHat early education has a permanent effect on 

IQ scores. The evidence seems to indicate that, on the average, 
well-run early education programs can increase a child's ability 
to perform well on IQ tests and that this increase in skills 
lasts for reveral years but eventually fades. The effect of the 
early education then, in terms of skills whtch are measurable 
by IQ tests, is certainly of far more value than a temporary 
fluctuation in skill levels but does not constitute a permanent 
increase in intellectual skills. The children's ability to 
deal with intellectual problems, then, is genuinely increased for 
a number of years. The child is not simply geared up to take a 
particular test. 

The obvious question which arises from this p-idenco Is whether such <m 
increase in skills is valuable. This question is not direct ly answerable 
in this report; however, a related question can presumably shed some light 
on it. Specifically, did these programs enable children to function hf^fter in 
school, than the control children? This effect could have been the product 
of the effect on IQ or of other effects of the programs (such as social 
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effects or effects on parental attitudes). The following section will 
attempt to answer this cfuestion. 

D. Analysis of Assign ment to Special Education and of Grade Failure 
Intelligence tests are designed to predict academic achievement. 
Obviously actual achievement is a better measure than is a pcedictive 
instrument. this section we. examine two indicators of actual school 

performance. 

This section i nvc>Kl' igates whether low-income children who attend 
early education programs'are less likely to be Assigned to speical 
education classes, and whether they are less likely to be held back in 

4 

grade. Wo found that early e'ducation do.es improve the ability of low- 
income children to meet the minimal requirements of their schools. The 
analysis is based on the results of eight independently conducted 
early education pro^rnms which have examined the school records of the 
children wlio attended the programs and of control children, 

Ihe use of these outcomes (whether a child was held back in grade a;.d 
assignment to special education classes) as measures of the cf f cct ivonef>j: 
of early ed.icaLicn programs has one major advantage over the use of IQ 
or achievement tests in that grade failure and special c'.ication placemen 
are concrete indicators of whether a%.child has performed acceptably withi 
his/her oducntional institution. 

The U5.e of these outcome measures, however, does have a drawback in 
that both outcomes are affected by the policies of the individual states 
and school districts. Wlii le the subjects were orlKinally living in a 
very small numbt»r of communities, by the t^'me of this follow-up they 
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had- attended several hundred different schools. We do not have information 
on the distribution of promotion policies or the relative availaDility 
of special education classes in most of these school districts,- We ar^ 
assuming that with so. large a number they are reprei intative of. .the national 
situation, about which some information is available. Moreiover, since 
both special education and grade failure are methods 'for dealing with 
cl^ildren who do not meet minimal school requirements, the two may 
overlap to some extent as outcomes. For instance, if one project 
finds a significant effect on assignment to special education, but no 
significant effect on being held back in grade, while a second project 
finds the reverse, one could attribute these results to the fact that the 
former school district tends to place low achievement children in special 
education classes while the latter district tends to retain them in grade 
for a year. In fact, of the projects which have reported both special 
education and grade failure data thus far, none have had significant 
effects on both outcomes; however, all- projects but one haye had effects 
with a significance level of ,10 or less on one of the tvo outcomes. 

The combined evidence from fivp projects which looked at whether 
the children had been assigned to special education classes shows that 
early education significantly reduces the^ number of children assigned 
to special education. 

- The combined evidence from seven projects which looked at whether 
the children had been held back in grade indicates that early education 
significantly reduces the number of children held back. 

An additional project, which compared the high-risk children whvi 



• attended its program to the geheral school population, found that the 
pll^V ' A^*«^ogram children were held back no more often than the genera>-school 

population. Further, there was no significant differ^ce in the rate of 
-1-1-7 assignment to special education between p . ogram..children and the .g,eneral 
school population.. 

The importance of reducing the number of children 'assigned to special 
education of* retained in grade is so great that it scarcely seems • 
necessary to elucidate it here. The value of reducing the number of 
children who musr undergo the trauma of being labeled "educable mentally 
retarded" or •of* fall^n^ a grrfde ^ 'as well as *th^ v|\lve ofi chh •cor . savings 
to the school systens - is self-evident. 

The same analytic technique wa^ applied to both special education and 
' ' grade failure data. Crosstabulations of whether the child was in cne 
program with outcome (e.g., whether the child was assigned to special 
education) ^are performed for each project individually* Yates' adjusted 
chi-square stati.^tic Is computed. The significance levels are then pooled 
across projects, giving an indication of whether the overall evidence 
when consfdering all projects cogether (^i.e., considering each ^ject as 
an independent replication of the others) showf a s,igni£icant difference.^ 
• The pooling of significance levels is accomplished in two stages. Fir^t, 
significance levels are pooled only for ose projects Which had designs' 
which were very near to being experimental. SecoriJ , significance levels 
are pooled for ail projects, including those which were more quasi- 
experimental. 
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ThBlse .analyses are -organized In four sectfons: 
• 1. special education results of -five studies* 
.2,\t'rade failure resultfe 6x seven studies ^ 

3. * results for the Micro-Social Learnir^ System / 

4. sununary ^and implications . - \ ^, 

I. Special Education 

— — " V 

. " Dd^ta from five projects comparing the incidence of assignment to 
special education between program children and control children presents 

^'Strong evidence that preschool education for I9W- income ^hildren reduces 

4 . I 
. i the number of children assi^ed to speciar education daring their school 

<| ^ years. ^ ' • * 

For each of the five projects, a crosstabiilation of whether the child 
was in the program and whether (s)he was Assigned to special education ^ ^ ^ 
was performed and the Yates adjusted cM-square was computed. Results 

are shown in Table 10. The Gordon ,<5ray and Levenstein projects all show 
' • 1 ^ , 

sigiificant reductions in the number of children assigned to special 

education. The Perry Preschool project .shows a two-tailed significance 

level of .096 and, tbws, comes very close to being statistically significant 

(i,e,, having a significance level of .05 or I6ss) . For all four projects, 

the differences in the percent of children assigned to spg^al education 

are striking: for Gordon,, 9% of program vs. 30% of controls; for Gray* "^f- 

of program vs. 29% pf controls; f or Xevenstein, 10% of program vs. 39% 

of controls; and for Welkart, 14% of program vs. 28% of controls. Only 

the Milier project gives no Indication of a re.r'uction in the number of 

' children ^s^gned to special education.** tne pooled significance level 



* The two-tailed significance l6vel for the Gordon project waf, .052. 
One-tailed significance tests result in significant differences for 
alLbut the Miller project. 
** See note on Miller data in Appendix B-*l. 
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.for the iive projoctf? (using the technique recommended by Darlington) Is 

Thus, the overall evidence of the five projects (comparing 461 
children) shows that early education does significantly reduce the 
number of children in special education ^ 

It is importaTit to noire that the projects with the most nearly 
random procedures for assigning children to program or control groups 
had, in general, the most impressive results. The Gordon, Gray and 
Weikart projects had the most stringent sample assignment procedures ^ 
(i^e^, most closely approximating. an experimental design). Pooling only 
the results of these projects gives a significance level of ♦0006, agaln^ 
ijidicting a statistically significant reduction^ Ihusj it seems' fall' 
to say that the results with respect co special education are not due 
to any self-selection factor^ The only project in which a difference 
was uot found (Miller's) had < nonexperimental procedure for creating d 
control group, due to the fact that this project was primarily concerned 
with comparing different curricula, not comj)aring prograir children i^ith 
those, who h<ui lot rorelvui any program^* ^ (See Appendix B-1 for summaries 
of the sample assignment procedures of each proj- t.) 

Perhaps the most interesting column in Table 10 l« the last column 
(graphed in f'igure 8), which gives the percentage reduction in children 
in special education for^each project (e.g., the Gordon d^^a eKtinyUcs 
that 69X of th(> low- income cliildren wlio could T^iormally he oxpei tod to 
be in speVial voducation i^ould not need to be in special education If 



* Accordiaig to a recLMit report by <hc Jefferson County (LouUsville) Fchool 
Board based on tlie 1976-1977 school year* the overall diftrtrict rate of 
assignment of blacks to special education classes wis h^»her th*»n that o 
Miller's exper ilnet<tal groups. 



they were given c^irly stimulation)- *\lthough the number of children 
in a glvert study Is small, in the data from all p«*oi^'^^^« (t>xcept Miller's) 
the percentage reduction is verv substantial (irom 50.2% to 90, 5Z)- 
Four q( the proj^'t t^ reduc<.<l the expected number of cf^lldren In special 
education by more than 50t. It Is unlikely tha' these findings would 
.ix^ affecti^d bv j$amRle fluctuations* 

hi additiun IP tiw abov^ results, the dota from ihv Miller and 
^tti€:H ptolvriH, which uere designed to compare different preschool 
currleuU* indicate no significant dlfCerence^n in the rate of .issinn- 
^nt to s^p4H;i4! education related to different curricula (see Table 11), 
IntiireiJC ln?n enough* the two projects showed similar resultn for the 
thre<* i^urrlcuht compared by both projactsj of the three-, 8ercitt*r- 
EngeJ^tnn ^t^d ^he j^teateiSt percentage assigned to special education. 
H^inte*^^»^r! vh'^ it- rhc twiddle, and tratUtionnl had t\w smallej^t 
percenta^^a jut^i^m-d.* Th^'He resultii, ihi^igh conjilntent , u.-r^^ noC 
3St<m*i<U<nv -.i^nif li. ^nt tot eith^ f project. 



n XUt's UAKCEh group had thv hl«hofU t.iti- arr.. ■■ • th.u tnn',.»i!*H i,.ur 
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Crosstabulatlons of whether the child had been held back with 
whether s(he) was in Che prograni weie perforicied. Yates' adjusted chi- 
squares were calculated tor each project. 

One should first note from Tables 10 and 12 that the percent of control 
children held bnck in grade varies far mpre among projects than <?o^s 
the percent of control children; placed in . special education. This is due 
to two factors: fir t. the children in th? different projects are of 
difft*rent nnd, hence, the projects with older children generally 

have more children held back because thers were more years in which they, 
tould have be^'n li>ft back^; and sec d, in the many school districts 
where social promoiton is practiced, retention ^in grade is a less 
frequently used way of dealing with children who are academically 
falling. (In four of the six projects, the control children were held 
back IvSH i.rii^n th.ui ; lu v wimv cj.ss{gned to Kprcial eduratioiO. 

Ah sei*n in Tahh* \2, when each project is considered Individually only 

Palmer's project .Significantly reduced the number of failures. None of 

th^ projects which had signir icantly reducecf the rate of assignment to 

special education al.*=5o reduced the number of children who 'were held bad* 

However, the combined results of the r jvcn projects indicate a statistically 

significant reduction, as do the combfoed results of the fou; projects 
♦ 

most c.'osely approximating true eJcperimcnts* Tlius, although the 'overall 
d^ita eests thiU early education can reduce the rate of failtirt* for 
-'lov-lncomc children, the evidence Is not so strong a& the evidence for , 
reduction in sperial education.' ^Is could he partlalfy due to tl»e fact 

^ Assignment to spe* ial education tend« to. occur prim^^rlly during the 
early K^^ules, whih- retention is m<» tkelv to occur :tl anv time. 
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that policy with respect to retention varies more widely among school 
districts than does policy with respect to special education. In any 
event, the findings must be viewed in light of the fact that four of these 
projects produced significant or nenr-signif leant reductions in the rate 
of assignment to special education (see Figure? 9 and 10). 

The Karnes and Miller projects show no significant differences among 
the different curricula in grade failure. (See Table r3.) 
(Note: See Appendix D for explanation of slight differences between these 
^ analyses and those reported in "Preliminary Findings of Developmental 
Continuity Longitudinal Study/' May, 1977.) 

3. Grade Failure and Special Education in Uie Micro^SoclalJ^earn^ 
System Project 

The Micro-Social Earning System Ir. ''ineland. New Jersrs , is discussed 
separately due to the nature of its cont- ol group. Sinco the program 
children In this project consisted of the highest risk children In the 
school district, ^here did not exist a sufflcientlv large non-treated 
group which could be used as a control group. Theref-r.. It was d..Ided 
not to compare the h1gh-ri.k program children to a similar oopulailon, 
but rather to th. gunernl school population. A random sample of the pU-vlous 
year's first grade population was chosen. Vms, cumpavlsons could be 
made to soe how the high-risk program children compared to the g* ^er.-il 
school population in Vlnoland. Tl^e general school population Included 
middle rlass as wt-l! as lower c'.n.ss children. 

Because the program group had a much hight-r pi-rrontagc of Sp- Ish 
uurnamed rhildr-.-n than t h. K^Mi.-ra! s. hool population, an additional thi . 
six Sp.miMh .hi,.!r.n wrf randoml-. s.-lc i<-.l fr..D i ho rr lo.- st-ar's fii.t 
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grade population. Thirst* ,iddlCional i lu Idren allowed tlie comparison of 
Spanish surnamed progiam children to Spanish surnamed children in the 
general school population, and, in effect, constituted a control for 
ethnicity and social class (since most of the Spanish speaking children 
were from the lower class). 

Thus, two comparisons could be made: 

(1) program children to the rindt^m sample of the general school 
population (i.e., excluding the^add it ional thirty-six Spanish 
surnamed diihireiO 
' (J) Spanish sunuinicd program rhildrtn to a r^indom sample ot Spanish 
surnamed ^Im Ulrcn in the general iichool population (itu hiding 
^ irh cHt" {hirrv--iy additional ^'hlldren and the Spanish 
oh 1 lure' \i\ the first sarnple*^. 
Kmplovini; Uu-^e fw* i^^np^r ! son** rev^eals that t Mi e r^^-Soi i a I 
pro5:ram had -hi imprt-iiv^ and slgniti^ant effect t>n r*'d;u'fnjt ihr ?Min^* i 

of program tliildien who w* rr h.eld hark, in K^ade, Hven Jhoui^h the pr > ^ 
« 

rhlldren *onsticut»'? ihv nti'h ► p*»p 1 M Jon oi thv srhnr»I djstriif , f'n* / 
were retrained no rrHjf i^rten than t ht* gt»neral M<htiol p^'jiuKit s.^i . * As ^een 
in Tabu* I'MaK t !hn « wi, n*- i^'tUfl*inU clilfereni*- between proi^rair. 
rhildft-n »nd i\u^ r.ind'fi ^implr i^i th** ^,efn r * s< nooj '^i^pulaslnn in i ho 
number of ehil<lr<'n ht)'* • k k . Thv (irfvrat*^ t b'l fyiparvd t ht* 4hjijdr»Mt 
to meet mi^tinuil Jun^* r*«qu l retno?U well a*i the j»en<'ral Iuk*} 

pcjpu lilt ion . r^tls t-vw!en*«» is cjade **v<»n nnre t-ipr<'n*iivt* when on^ 
< omp.irt ^ t' '*',v.i?M^ti jr */,f,in >hndrtn vi;?t f J«i spaj t • *» 

^ Kiuic the r.uu^on I'^^.-J * ? ^miv'^'I '-rfio-.l r PuKit ion ^.ld . ;i 

«ihool 'Mie vr.ir KMH*-'r * ^ rlu- pr.^i.- jf?, ehi Idr^^n , tnv ^hl!«! m t ^e 
iamio?L ' H ^>nl^ m (he l.ist v* ?r w.in ,o?snf^d 

never ijavinK * - - b,M h j« W s svir*^d eh^f the , Mn/ir U.»n . m'. J 

not he j> . h «hih! IS t.^inet 

^1. 



children in general. As shov^ in Table 14(b). a significantly lower 
percentage of the program children were held back (32.8% retained as 
compared to' 62.9%). Thus, tho program children were held back at a 
significantly lower rate than the general school popurlation when even 
,thil rough control for ethnicity and social class was employed. 

The data on 'assignment to special education did noc reveal as marked 
an effect, although this may have been due to the fact that the highest 
risk children were asaigne to the program. As seen in Table iS-(a).. 
there was not a significant difference between the program children 
and the general school population; however, the difference was very 
close to significance - pK.066. Further, as.seen in T%le 15.s), ^ 
there was no significant difference in assignment to special educatipn 
between Spanish speaking program. children and the general Spanish 
population. 

The fact that the Hicro-Soclal program had a significant effect ort 
retention t ..ot on special education. while other projects ^ -f signlf'-cant 
effects on assignment to opecVal education but notion being held back, 
recallu - the hypothepi-? that these programs lo alfect the percentage 
of children whomet: minimal school requirements and thai the question 
of whether they affect the tate of gr^ide failure or the rate of assignment 
tojpc\^\ f-ductlon may be as much a function of the school district's 
policy on h<« to deal with underachieving children as it Is a function of 
the f«pecific curri.-.ilar effects of the carl? education progranv. 

rne Hicro-5^octal findings on the effe-t of thi> program on retention, 
then, are quit.- impr^-.lv.- tht.y Indi.at^ that, given sur-h an early^ 
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Intervention pfogram. high risk children were able to ni^et the minin^al 
school requirements just as well as the general schuoi population. 



A . Summar y of Implications of S pecial Education and Grade Failur e 
Analysis 

The data present very strong evidence that early education for low- income 
children impxtxvea-tiieir ability to meet the minimal requirements of the 
schools "they enter. 

The combined oota frv.m five studies indicate that early education 

reduces the number of ihildren who were placed in special education classes 

during their 5>choi>l vears. Vuur of the studies show reductions ranging from 
50^ to 90% in Che numb r oi children assigned Co special classes (with ai^ 

significance levels bch^w .10). The fifth found no significant differences. 

The comb ImfiT result -» of the five projects showed that thv reduction wn« 

significant (p < :ni). 

The combined data from seven Htudles indicates that earlv educat ioti 

reduces the number of low inctfme children who are held 'ack in grade one or 

more times ^^^^.O*)). Uhor\ thes^* studies are considered separateiv, ijowcver* 

onlv PaLi"r*N pti^j^«<t showed a sicnifioant reduction. tlorn* <f tfie prohnti 

t 

which bignincantl% reduced the rate f assignment to special edtuatton als,> 
ftignificanilv redurod ^^rade failure. 

Tlu* Mi T' St>* i.ij I i>arninvrSvHtem found that f^ij^h rl^^k cluldrt^n in its 
program wi»rv lu id na* k n** mi.M e MTtt^n than tlie general school pi^puiaiion. It 
also found a .i^^i. Meant r».nni< t ion in the number of Spanijih sp^*aUing rhildten 



The combined resets from ail projects indicate that cnrly educ^ation 
helps low-incotne children to r.ieet the mininMl requirements of their schools. 
This .'.an consist of reducing the probability of either being assigned to 

special education* classes or being held back in grade. The spe'^ific effect 

t 

of a program could be primarily a function of the predomlnane policies of 
local schools for dealing with children who do not meet the minimal 

"requirements. Thus, it appears that early education can result in cost 
sayings.be reducing the rate of assignment to special education and/or 

"The rate of grade failure. Moie importantly, there is now evidence that ^ 
early education can improve the probability that low income children 
will be able uo perform acceptably in school and not become labeled as 
failures-. 

The last section of Part IV will discuss the analysis of school- 

'# 

related responses from the Youth Interview. 



T able 10; Effects of K arly Kducation on S pecial Educ ation for Projects 



Pruject 



% Program 
Children in 
Special Ed . 



% Control Two-tailed % Reduction 

Children in Chi-- Significance in Children 

Special Ed . Square Level ' in Specia l Eu. 



Closely Apprcx. ^ 
Experim ental Design 

Gordon^ 

^ 3 
Gray 

Wcxkart 



9.4 
2.8 
13.8 



30.0 
29.4 
27.7 



■J 

Pooled z score for three projects = 3.46 
Tooled significance leve^l^ = .0006 



Experimental 



j^«?\/enstein 
6 



It 



Lie'- 



10. ! 

?0.4 



39.1 
12.5 



Pooled >• scorf for tl.o j^rojocts = 
tooled s igni f it .Hit h*vt»l' = ,0002 

Total N = 461 



3./8 



3.74 
5.72 
2.77 



8.17 
0.16 



.0524 
.0168 
.0962 



. 004 
(.6892) 



68.7 
90.5 
50.2 



(38.73%) 



foo tnotes : 

1 « (1 - T' 'Voi:r.M' Mil Idrcn in Sjhm ial Kd . / ^' rontrol Clildren In Special Ed.)) 

2 Majority ot rhiWlrtMi in )td ^.radr, Prograni N-64 , Control N»20 
J Majority of (hildrt-n in 1 ^'U Rrade, Program N=36, Control N«*l7 
4 Majority of children in l^lh grade, Program N==''i8, Control N=^>5 

1 Majority of rhildr(M! n 3rd grade. Program N=69, Control N=23 

6 Majorirv of rhfldron in 7th ,gradc, Program N-93, Control N«16 

7 iv^oled = wlifrf p > score for significance loveltof the flh project. 

Vn?^ K ' lumber of proJ<*cLfJ / 

8 Indicares tlint a ^re.ittT portontage of program clilldren arc in spt-cial education 

9 Two-tai led 
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Figure 7 ■ Percent of Program and Control qiildren in S pecial Education 
Percent 

40 I m ^ 




Gordon Gray Weikart Levensteln Miller 



Figure 8 ■ Percentage Rgduction i n Quldren in Special Education 
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Table 11: The 'Effect of Different: Curricula on Assiftmnent to Special Education* 



Louise Miller Project ^* 



Rereiter- 

DARCEE Englgmann Montessori Traditional •*:>rii 



Assigned to 
Special Education 7 



6 3 3 19 

(25.9%) (23.1%) (17.6%) (12.5%) (20.4%) 



Not 



or 



0 ' 21 /4 

(73. (76.9%) (82.4%) <87.5%) (79.65f^, 



total :>6 26 1 7 24 .3 



X*^ = ! . 796 N(>i Sij^'.ni I &'Jiit: 



Assigf"- '. to 
r^pc-clal Fducation 



Merlp Karnes Projecjt 

Bereiter- Commu-lty 

COM Engel-nann Montessori Tt^diiional !ntO);r.it.cd Tr-^l 

, A e, 2 6 2' • 



Not 
Ass Igned 



total 



{..on 



9 

n 



6 

(7 5.0"'f 



5 



11 



3'* 



63 



* (•omn..Vi.T..ns h,-.w,..-n ..udi.-^ .-.mn -t be dirf•<t:^ mndo due to differing 
,,v,,M,,bint.. ■ i .l .■du,..tion clause- among ihv varion. «rn...'W- 

,9 J 
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Table 12: Effects of Early Education on Grade Failure for Five Projects 



PROJECT 

.'Closely Approx. 
Experimental .Design 



% Program 
Children * 
Held Back 



% Control 
Children 
Held Back 



Two-tailed' % .Reduca^tion 
Chi- ' Significance in (!^iildr6n 

Jield Back 



Square 



Level 



2 

Gorpon 7.1 


9.5 


.011.6 


; ,9204 


25.26 

V 


Gray^ 51.5 


66.7 


.3196 


.5686 


22.79 


Palmer^ 22.0 


45.0 


' 11.54 


.001 


51.11 


Weikart^ • 3.4 


10.8 


1.463^- 


.226 


68.52 


, Pooled z score^*^ for four projects = 2.64 
P/OOled significance level^^ = .008 








Quasi- 
Experimental. 






* 




Le vens te in^ 13.2 


13.0 


.0006 


(.9840) 


(1.54)' 

/ 


' Miller^ - 6.7 
Zigler^ 26.6 


o' 


,3509 


• (.5552) 


32.3 


.32 


.5700 


17.65 



Fooled z score^^ for seven projects = 1*98 
Pooled significance level^^ = ".0^78 

Total N ^ 827 

Foo^^otes: ^ ^ ^ 

2 Majority of cMLdien in 3rd grade, Program N ^ . Control N«2l 

3 Majority o\ rldTdren in Uth grade, Program N - i', Control N«12 

4 l-iajority of chlfdren In 5Lb grade, i rogram N - 131. Coht r« 1 N°42 
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5 Majerlty of children in Ath gr^ade. Program N =^'8r Cont 

6 hiajorlty of children in Ird gf<fde, Program fT^bS, Coticrol N»23 , 

7 lajofity of children in 7th grade, Progmm N - 105% Control N - 18 

8"^ Majority of children in 7th and 8th grade. Progrhm N « ^9, Contfo! ^ ^ 

9 Indicates that a greater percentage of program children w^re retailed 

10 Pooled / -ijX.''^'^'*'' " ^""^ signiflcan o level of the pth project 

. K « number of >nrojcct« 

11 two-tailed 



Figure 9 . Per cent of Program an d CaitroJ^Oi/ xdr^m Back a Grade 
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Figure 10. Pe rcentage. Reduction .in Childrai -Hel<i Back in Grade 
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Table 13: The Effect of Different Curricula oivt:rjiclO-.'''A' 



Held Back 



' Not 
Held Back 



total 



Louise Hi] lor Project 



DARCEE 

1 . 
(3.7%) 



Bereiter- 
Engelmann 

3 

(10.0%) 



.26 * 
(96.3;!^ 



27 

(90.0%) 



27 30 



X = 1.016 



Not Significant 




Montessori Traditional total 



1 

(5.0%) 



19 

(95. Ot) 



20 



Merle Karnes Prelect 



2 , 
(7.1%) 



26 

(92.9%) 



28 



7 

(6.7%) 



98 

(93.3%) 



105 



Held Back 



I 

Not , ■ 
Held Back 



totdl 



COAL 
A 

(18.2- ) 



18 



Bereiter- , 
Engelmann 

2 

(20.0%) 



8 

(80%) 



Montessorl 
3 

( 2i . A%) 



H 

(78.6%) 



22 



C 10 



2.6 >2 • Nor Significant 



Traditional 

0 , 
'(0%> 



8 

(10C>2) 



Community 
Integrated 

l- 
(8.3%) 



li 

(91.7%) 
•12 



total 
(13.4%) 



56 

(SA.6%) 



66 



ERiC 
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T able lA: Th e Ef f CLC_t_otJil£.ili£riL-iQ£i^ Failure 
(a) Program Children vs. General School Population 

Pr6grain N 

X of Program 

General Popultition N 
% of Gvner*il 

Population ^ ^il^ 
Total 

(b) ..ipanii^i. -tinimcd Pi %:ram aiiarcA ^s. Sp*nuj*b Surnaiucd School hipuUti^^^ 



Not Retained 


Retained 


Totjil 






1% 


(68.0%) 


(3J.0J) 




66 




101 








198 


9? 


29$ 



? of Progr<im 

4 of r.^pulac r'*n 
Total 

RIgniflc.mce < .001 





Re! .il{_U»d 






















• '? . H) 


(6.'. 
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Table 15; 



The Effects of the Micro-Social Learnin g Sy stem 
on Assignment to Special Education^ ^ 



(a) Program Children vs. General School Population 



Not in Special 
Education 



In Special 
Education 



Total 



Program N 

% of Program 



16^. 

(86.2%) 



\27 
(13.8%) 



196 
(100%) 



General Population N 
% of General 
Population 



95 
(94.1%) 



(5.9%) 0 



101 
(100%) 



Total 

= 3.39 
Significance = .066 " ' 



264 



33 



297 



(b) Spanish Surnamed Program Childreh vs. Spanish Surnamed School Population 



Not in Special 
Edutation 



In Special 
Education 



Total 



Program N 

% of Program 



104 

(86.0%) 



17 
(14.0%) 



121 
(100%) 



Population N 

% of Population 



54 
(87.1%) 



. 8 
(12.9%) 



62 
(100%) 



Total 

== 0.0002 
Significance = .99 



158 



25 



183 
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E. Analysis of Schooling Variables from Youth Interviews 

w 

The next question is; how far will these children go in school and what 
factors motivate them? Measures of motivation such as self-concept and 
educational aspiration are thought to play ^ role in the number of years 
of schooling completed. Thre,e variables from the Youth Interview provide 
information on the educational attainment process. These variables are: 
Current Status in School (Question 1); Educational Aspiration (Question 2); 
and Self -Evaluation of Schoolwork (Question 5). A total of 773 Youth 
Interviews from nine project sites were available on July 1 to investigate 
differences between program and control groups. The preliminary analyses 
Indicate: 

-.A slight tendency for more control than program, children to drop 
out of school, and a trend for control children who drop out to leave 
school at a younger age compared to program dropouts. The differences 
are not significant, but these findings warrant further investigation 
when the data collection is completed; 

- tlie chi Ldren who participatnd in early education programs do not 
appear to have educational aspirations that differ from children who ^ 
did not participate; 

- there is, liowever, evidence in Consortium data that program 
children rat^ how they feel they are doing in school higher than children 
who did not participate in early educational programs. The analysis 
related to this self-concept finding is discussed below. 

1. Self-Evaluation of School Work 

Self-concept is a variable often suggested to be related to 
educational attainment. Enhancement of self-concept, in addition, was 
often an expressed go j I of onrly intervention programs. Question 5 in 
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the Youth Interview was designed as a measure of self-evaluation related 
-to Current *self-concept in order to asses an important aspect of the long 
term impact of early intervention programs. 

Question 5: "How are you doing (did you do) in your schoolwork; 

that is, overall, not just in one subject? Is your 
schoolwork ... much better than the others, about 
the same as others, a little worse than others, much 
^ worse than others?" 

.The response to this question indicated how the sample evaluate their. 

school work compared to their classmates. For this sample (N == 7-31),, 

5.6% rated themselves much better than others; 30.5% rated themselves 

a little better; 54.3% said they were* about the same; 8.5% rated themselves 

worse than others; and 1.1% rated themselves much worse than others. 

Chi square analyses show a significant treatment effect for the dlder 

subjects. The program group whibh had participated in Beller, Weikart, 

Gray and Deutsch's early intervention programs are now at least fifteen 

years old. These program children are significantly more likely to rate 

themselves better than others in their school work compared to their 

controls (X"^ « 7.812, p =<.020) as shown in Table 16. 



Table 16; Self-evaluation of School Work by Program 

or Control Status (older project sit ^3 onl y) ( 



Self rating % Control % Program 

Better than others ^ 33^:^5 48.5 

About the same \ 56.6 47.7 

Worse than others '9.8 3.8 

N of cases 122 132 

= 7.812, D - < .020 
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Looking at the four project sites individually, they are all in the 

2 

predicted direction but only Deutsch is significant (X = 5.94, p *05) . 

•* *- 
The program vs. control comparison is not significant for the younger 

subjects and there are no significant sex differences. 

Taken wiuh the other data on special education placement and failure 

to be promoted, this self-rating data would appear to be a relatively 

accurate assessment. There is no reason to expect that the program group 
would be mord likely than the controlt. to say what they think the 
interviewer would' like, to hear, and it is assumed that the interviewers 
for the most part were blind to the program or control status of the 
respondent. This program effect appears in the sample when the subjects 
reach high school — a time when decisions about educational goals are 
critical. 

In sum, further analyses of Youth as well as Parent Interview response 
can serve as an important data source for the investigation of attitudinai 
and interpersonal variables that mediate the effect of early educatiju 
later educational outcomes. 

Because of the complexity of analysis of the interview data, and 
because it does not contribute particularly to the main effects reported 
in this paper, we have decided to delay its full treatment until the wholf* 
body of data has been received. 

Several studies experienced unavoidable delays in data gathering while 
waiting for school districts to decide upon the adequacy of their informed 
consent and privacy procedures. All finally did get access to school 
data, but in one study (Beller) data collection will not be completed 
until later in the fall, and in several other cases, data could not be 
collected in time for this required report. 
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/ • ^ • . " PART V - - - • 

ANALYSIS OF DELIVERY SYSTEMS 

I ■ 

A*** Parental Evaluations of Programs 

As part of the Parent Interviews^ parents of the experimental and 
of some of the control children were asked to evaluate the progratns their 
children had been in ten years earlier, ' The responses of these 684 
parents were quite positive, and these final results confirm the 
preliminary findings reported in May on several hundred fewer 
respondents, 

Ifliile in some studies control parents were asked to evaluate 
•'programs" in order to maintain the blind condition of the interviewer, 
the primary results to be reported here are from interviews with parents 
of experimental children. 

In response to the question, ''Was the program a good -thing for 
your child?" many more parents answered "yes" than "no" or "don't know," 
As may be seen in Table IJ, all of the parents whose children had been 



in home-based programs answered the question positively, as did 93,4% 



of the parents of childr^en from oenler-based programs, and 87,8% of the 
parents of children who; had been in cotjibination programs, Theresas 
more-uncertainty, however, in the center and combination delivery systems 
where nineteen parent^ (4,3%) and seventeen parents (10,9%) respectively 
answered that they djLd not know whether the program had been a good thing 
or not. Ten (2, 3%) /of the center-based program parents and two (1.3%) of 
the combination program parents stated tiiai: the programs h,id not been 

good for their children. While these last negative findings might be 
of concern to program administrators, they are extremely small 
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percent ages, and may indeed be indicators of the validity of the 
interview in that this question evidently was not (at least to some 
parents) one that intrinsically demanded a positive parental response. 



Table 17* Responses to Parental Interview Question "Was the Program 
A Good Thing for Your Chlldg*' By Delivery System 



Answeir 

Yes 

No 

Don' t 
Know 

Total 



Center 
N % 

412 93.4 

10 2.3 

19 4.3 

441 100 
y 

x2 = 18.055 



K=684 . 

Home 
N % ^ 

87 100 



89 100 

p =<.C)012 



Combination 
N % 

/ 

2 1.3 



17 10.9 
156 100 



The chi-square performed for relationships between the variables of 
answers to the question and delivery system reveals a statisticcilly 
Significant relationship, with home programs being most likely to have ^ 
parents who answered the question positivaly. 

In order to determine the basis of their judgments about the program's 
value, the parents were asked what they liked best. Vlhlle there Wc's 
considerable variance across delivery systems (which will be discussed 
below), overall the best liked category related to cognitive aspects ot 
the program. This group o/ responses included mentions of learning with 

toys, etc. Next most popular overall were program characteristics "22.3%), 
♦ 

Includjng toachev-oh i Id ratio, length of program, materials, etc, Also 
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approved of at similar l^evels were the total prAgram (13,6%), parental 

aspects (13,1%), and social aspects (15 •4%), Additional services (suqli 

t 

as medical care) accounte'd for 3% and "nothing** (usually meaning-., 
"nothing in particular") accounted for 1,2%, 



1 

\ 



\ 



the Program Your 


Child was In? 


" By Delivery System 








•1 
) 

! 

i 


N=605 










Center! 
N % 


Home 
N % 




Combination '• 
N • % 


Cognitive Aspects 


134 


34.3 


17 


20.5 


40 


30.5 


Program Characteristics 


85 


21.7 


29 


34.9 


21 


16.0 


Social Characteristics 


80 


20.5 


2 


2. A 


11 


8.4 


Total Program 


43 


11.0 


15 

* 


18.1 


24 


18.3 


-Parental Aspects 


29 


7.4 


19 


22.9 


31" 


23.7 


Additional Services 


J.5 


3.8 


1 


1.2 


2 


1.5 


Nothing 


5 


1.3 






2 


1.5 


Total 


391 




. 83 
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Of particular interest are the differences among the delivery systems 
on social, parental, and program characteristics. As would be hypothesized, 
parents of children who had been in center -based progams (which had the 
salient feature of groups, of children interacting with each other and with 
adults) were much more lively to identify social aspects of the program as 
best liked than were the parents of children who had been in the home or 
combination programs. Conversely, parents of children who had participated 
in home-based or coml^ination programs were nearly three times as likely to 
identify parental aspects as best liked as were parents of children who had 
been in center-based programs, 
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Even'^so, in no delivery system did the parents choose parental 
benefits more often than they .did direct benefits to their children. 
The most frequently mentioned category for the home-based programs was 
program characteristics and for the combination and center it was cognitive 
benefits. 

The last category "nothing" should not be interpreted as meaning that 
^be parents did not like anything about the program. Rather, analysis of 

answers for the seven parents who answered this way reveals that the 
answer apparently meant that they liked everything about the program and 
rat one thing in particular. Only one of the seven said that she did not 
1^'ke the program; two others said that they couldn't remember anything 
about the program except that it was nice. 

To obtain more critical evaluations of the programs, the parents 
were asked what they did not like and how they would have changed the 

program to make it better. By a wide margin, most parents responded that 

b 

"here was not anything they did not like. By delivery system, 84 . 1% , 83.1%- 
^and 89.6% of the center, home, and combination program parents responded 
in this manner. In other categories 8.7% overall answered that they did 
not like some of the characteristics of the program (like the teaching 
philosophy). 

As to what they would (^hange about the programs, 57,3% overall said 

that 'they would change nothing, 13.8% responded that they would change 

program characteristics such as the length or frequency of the program. 

Other categories wero quite low in responses. 

1*he parents wiM'e nskod if they liked the location of the program. 

',A preceding statemetit explained that sometimes programs for young. 

.liclrvn 311.^ conducted in centers and sometimes a home visitor brings 
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activities to the home.) Parents in both home and center programs 
preferrod the location that they had utilized; 98.8 ami ^U>.(>".. ot" 



the location of the program. Only one parent from a center-based 
program and three from home-based programs did not like the location of 
the program, as may be seen in Table l9. 



Table 10 ♦ P^«nnn«P^ f o the Question "Did You Like Having the 
" P rogram in a Home/Center?" By De livery System 





Home 
N 


% ■ 


Center 


% 


Yes 


84 


96.6 


422 


98.8 


No 


3 


3.4 


1 


.2 


Don' t 
Know - 


0 


0 


4 


.9 


Total 


87 


100 


427 


99.9 




For the combination programs^ the par,ents were asked if they liked 
.having the program in both locations; B8\7% (118 pal^ents) responded that 
they did like having both home and ceAter locations and -11.3% (fifteen 
parents) said tRat they did not like them. \^en asked if they preferred 
either the home or center component of the program, 58% (eighty par-^nts) 
had no preference, 31.2% (forty-three parents) preferred the center 
program, and 10.9% (fifteen parents) preferred the home program. 

When parents were asked why they lilied the location of the program, 
distinct differences emerged between the home and center-based studies. 
In contrast to what they liked best, the parents of children in home- 
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based studies moct frequently said that they liked parental 'aspects 
(76.2%). For the ceriter--based studies, the most frequent response was 
that they liked everything about the program -^r-. or that they "just 
liked it*' (27.2%). Another 25,9% of these parents answered that they 
liked the social aspects of tti8 center location. 

Similarly, when the combination program parents were asked what 
they liked best about, the double locations of those programs, 56 8% 
responded wiuh*mention of the parental aspects, while 18.9% an wered 

with the general "everything" or "T just liked it," "It was fine." 

■* • 

In summary, the pflrents stated that they considered the prog;rams 
to have been valuable to their chilaren in a variety ^f developmental 
ways. There was little that they did not like about the programs, and 
little that they would have changed. Generally, they liked the locati 
of the programs and the aspects of it that made the location unique; 
that is, parents of home-based and combination progrrr childrefv liked 
parental aspects of 'the programs and parents of center-based proprair 
childreii'\liked the total program best. ^ 

Generally it may be deduce^ that these programs were highly 
success,ful in obtaining parental satisfaction with their effdrts. 
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B . * ^rograirf lab 1 e's ^ Arialy s is 
' "TT^ ^ • ^ \, \ 

Are some I'ntervention programs^ significantly more effective than 
others? If soi what klnds^ of programs are most effective? We have Just 
b^gun* to •address this important set of questions. 

It seeing' reasonable to approach thi^s, topic in' four steps: 

Determine whether there are reliable differences among the 
programs, as measured by the difference between experimental group and 
.control group means on IQ's or other dependent variables. 

2. 'Determine whether these apparent differences among programs 
(if any such differences are found) mlght^be due t) the fact that some 
projects had methodological biases favoring experimental' groups, and other 
projects had methodological biases favoriug control groups. If such 
bilases existed, then statistically reliable differences might appear in 
the apparent effectiveness of the various programs, even if there were no 
real differences in program effectiveness, 

3, If differences among project results appear to be due to real 

differences in prograji effectiveness, the next step would be to determine 

whether these differences are caused by identifiable features of the 

programs, such as delivery system, staff training', etc., or whether they 

might be due merely to idiosyncratic features of individual programs that 
n 

cannot be replicated in the f uttlrej^'^uch as personal effectiveness of 
individual teachers or supervisors. This would involve demon^t^rating 
some consistency across projects, in the types of projects which yield 
superior results. v 

4. p the results of step 3 are positive, the next step would be 
to see whether program variables are confounded with each other. If 
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superior prog.rains consistently have feature A, do they also have feature 
B so that it is wot clear whidi feature produced the superiority? 

Of the four-step program which would be necessary before any useful 
conclusions can be drawn from this type of analysis, only the first 
step has even been approached seriously, and even there we have used 
only one dependent variable of perhaps minor interest — Stanf ord-Binet ' 
IQ measured immediately upon completion of the program. Only one 
statistically reliable difference has been detected thus far— programs 
having medium or high degr^'j of ^tea^hing structure appeared to have > 
gteater effects on immediate p^sttest IQ than pro^rbnis with low teaching 
structure. Even for thic finding we 'have not yet completed step 2 
above — determining whether this result might be caused by biases favcri 
the experimental groups in some projects. Preliminary insj-ection indicate 
*chat even if this finding survives a stage-2 analysis:, it will probably 
pot surv?.ve a stage-3 analysis. Thus the findings in this area so far — 
which involve only immediate posttest IQ — are essentially negative. 

0 

This does not mean that program characteristics have no effect on 
development. It may mean that there were too many ambiguities in our data 
to .'raw definite conclusions. Or it may be that clear differences will 
emerge for other dependent variables. Or it may mean that the projecti* 
we studied were all managed too skillfully f^or differences to appear, even 
if differences might appear for less carefully managed projes:ts. To 
take 'only one example, iO it makes no detectable difference whether 
children v^erc taught in groups of lWO or five children, there may never- 
theless be important differences between groups of two or five on the one 



hand, and groups of tv;enty or twenty-five chLldr-en oil the other. 

The stage--l analysis proceeded as follows. First, a measure of \ 
the effectiveness of each intervention program was computed. At first 
we considered using the simple difference between the mearts of the 
experimental and control groups for each project. However, because 
some subject populations were more homogeneous than others, and because 
different projects used different IQ posttests, it se^.med desirable to 
adjust these for the standard deviation of each projec .-ooresr^ 
To do this, we computed a point-biserial correlation for each projedt, 
between immediate posttest IQ and treatment-control status. This 
correlation is essentially a measure of t^e effectiveness of the project, 
as measured by immediate posttest IQ scores, standardized for the standard 
deviation of IQ's in the project. These effectiveness measures are 
shown in Table 20, 

A list of variables relevant to all programs, such as adult-child 
ratio, degree of structure in the teaching method, etc, was compiled' 
using many of the variables identified by Gordon, et al,* and by 
Goodson and Hess.** Based on written rep'-rts^and rnw data, each variable 
was assessed and assigned a value for each program (see Table 21), For 
example, degree of structure in trie Leaching method was determined to be 



* Gordon, et al , "Research Report of Parent Oriented Home--based Early 
^ Childhood Education Program." Institute for Development of Human 
-Resouices, May^ 1975. 

** Goodson, Barbara Dillon and Robert Hess, '*The Effects of Parent 

Training Programs on Child Performance and Parent Behavior." Stanford 
University, undated mimeograph. 
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lilgh, moderate, or low for each study. This listing was then sent to 
each Investigator for review and corrections before It was used Irl 
the analysis. Not all studies were Included In the analysis because 

V 

lists were not returned in time for the preparatlo^^ of this report. 

In addition, two sti^dies with the greatest diversity in program (Karnes* 



Curriculum l}bmparlsonr and Weikart *s Curriculum-Demons tration)--Could_nQt 

be Included in this analysis because they did not have control groups • 

For the analysis,^ each variable was forced into dlchotomous categories 



For example, farget Group was dichotomized as children only versus parents 
and children. Each study (or its relevant groups) was then assigned to 
the appropriate category. In those cases in which a' study was divided 
between groups, separate effectiveness correlations were calculated for 
**ach part of the study. 

Using the following formula, a z score^ was calculated for- each*, 
program variable. This formula was suggested by Richard Darlington 
and incorporate? the fact that the standard error of a low produce-moment 
correlation is about 1/n. 



K c.v. 



2 

n , 



= tlie effectiveness correlation 

v^ ~ a weight (the sum of all of which 
must equal zero) 

n^ = the number of subject.s in a study, 1 
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A total of twenty-five comparisons were made, irvolving fifteen ' 
different program variables. The uncorrected p-values for these 
comparisons are shown in Table 22. Each of these p-values should be 
multiplied by about twenty-five (the actual figure may vary slightly) 
obtain a slgniflcnnce levels to correct for the fact that they were 
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selected post hoc from among the twenty comparisons. WhcMi this step 
is taken, only one of the comparisons is still significant: for low 
teaching structure vs. medium or high teaching structure we have a 
significance level of 25 x .0014 ,035, It must be remembered that 
the effective sample size for this result is the total number of 
children in all projects together, or 2060. A result which is . 
significant at ouly the ,035 level in such a large sample should rtbt 



be taken too seriously. " - 

In summary, the analysis outlined at the beginiring of this section 
involves four "screens" which a finding must pass before' it can be taken 
seriously. So far, only one finding has passed even the first of these 
four screens, and its outlook for passing the other three screens seems 
dim. However, we have studied only immediate post test IQ, and more 
positive results might be found if other variables are studied. 
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Table 20; Correlations Between Immediate Posttest IQ 
and Treatment-Control Status 



Sample Size 

Seller 163 

Deutsch 740 

Gordon 186 

Gray-Early Training Project 87 

Gray-Family-Oriented Home Visitor 51 

Levenstein 150 

Miller 231 

Palmer " ,197 

Weikart Perry Preschool Project 120 

Weikart Carnegie Infant Study 36 

Zigler , .99 



Correlation 
.2073 
.3564 
^.1682 
.4982 
.2454 
.3082 
.0091 
.1289 
.2179 
.0890 
.0410' 



\ 



112 



\ 



-97- 





Table 21; Matrix of Program Descriptions 






Beller 


Deutsch 


Gordon * 


Age at 

begltmlctg of 
Intervention** 


* Group 1 • 4 yr. 
Group 2 - 3 yr. 


4 yrs. 


Groups 1,2,4,5 - 3 mo. 
groups 3,6 « 1 yr. 
Group 7-2 yrs. ■ 


Length of 
Xntervention 
tn Years 


Group 1 " 2 yrs. 
Group 2 » 1 yr. 


5 yrs. 


Group 1 "-2 yrs. 9 mo. 
Groups^ ,2,3,4 * 1 yr. 9 mo. 
Groups* 6,7 «• 1 yr. 


Length of 
Intervention 
In »o/yr. 


9 mos. 


9 mos. 


12 mos. 


Goala stated for 
parents and/or 
children ** 


Children 


Children 


^ Parents and children 


Geographic 
location by 
HEW regions** 


Region 3 
(Mid-Atlantic) 


Region 2 
(Northeastern) 


Region 4 
(Southeastern) 


Child Condition 
at Entry** 


Kormal 


Normal , 


Normal 


Delivery ^system** 
Site 


Center 


Center 

,^ 


Home; 

Home and Center 


Adult-Child 
ratio** 


Nursery School: 

1-7.5 
Kindergarten: 1-30 


Nursery School: 

1-7.5 
Kindergarten and 

above: 1-12.5 . 


Home: 1-1 
Center 


Staff 

Qua! if ica t ions 


Nursery profes- 
sional teacher 
]^araprof essional aide 
Kinder gar ten-Pro fes- 
sionaV teacher 


Professional 

teacher 
Paraprof essional' 

aide 


Paraprof esslonal 


Staff 
training 


In-Service 


Pre-Service and 
In-Service 


Pre-Service t~ 
^ and In-Service 


Progao 
goals 


Cognitive 
Affective 
LanKuase 


Cognitive, Langdage, 
Perceptual, Self- ^ 
Imape 


ijater nal , ,Qompe t ence . 
Child^Psycliombtor, _ 
*-Cognitive. Affective _, 


Degree of- ^ 
structure in 
teaching 
activities 


Moderate 


Moderate 


'''.^oder^e 


Specificity in 
Instruction by 
parents or teachers 


Moderate 


Moderate 


Moderate 


Emphasis on 
language training 


Mode'^ate 


High 


Moderate 


Philosophical 
orientation 


Traditional 
soclo/emotional 


Cognitive and 
sor.io/emot tonal 


Cognitive 


Involvement 


Moderate 


Moderate 


High 


Number of hours 
of intervention 
per year 


Nursery and 

Kindergarten; 
720~hr9/yr 


Nursery and Kinder- 
garten: 720 hr/yr 
_ School grades: 
135b\hr7vr 


Home: 52 hr/yr 
Center: 208 hr./yr 


> Hours per year 
X adult-child ratio 


Nursery and 

kindergarten: 
95.76 


Nursery Nana kinder- 
gar tent 93.6 
School grades: 108 


Home: 52 
Center: 104 - 


Child-child 
— ^ratio ' 


Nursery: 1-15 
Kindergarten: 1-30 


Nursery: 1-15 
Kindergarten and 
* — school -gardes: 
1-25 


Home: 0 
Center: 1-5 



* S,ee last section of Table 20 for key to Group Codes by prelect site. 
** These variables are taken from Gordon^or Good son and Hess. 
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Age at heglnnWof - *Group 1 - S.Syrs ^ 16'22mos. 



intervention** ' 



/ 

/ 

Ltngth of intervention 
in Years 


Group 1-2 yrs. 
Group 2 • 1 yr. 


Groups 1 & 3 " 2 yrs. ^ 
Groups 2 & A • 1 yr. 


Length of intervention 
.in no/yr. 


12 tttos.(10 week 
sujoaer school 9 mos. 
home visits) 




Goals stated for patents 
and/or children** 


^Both 


Both 


Geographic location 
by HEW regions** 


Region A *^ 
(Sou theas tarn) 


Region A 

(Southeastern) ' 


Child Condition at 
Entrv** 


Normal 


Normal 


^ — — 

Delivery system** _ 
Site 


Home and Center 


Home . 


Adult-Child 
ratio** • ^ 


1-A summer school 
1-1 home visits 


1-2 


Stdtf Qilalificationa 


Professional teacher, 
paraprofessional 
aides & home visitors 


Professional and para- 
professional 


.^Staff training - 


Pre-service and 
In-service 


Pre-service and In-service 
apprenticeship 


' — Lp 

Proj^ram Roals 


CpRnitive 
a'ttitudinal 


Cognitive affective, 
parental competence 


Degree o^ structure in 
teaching Activities 


High 


Moderat e ^ 


' Specificity in 
instruction by parents 
or' teachers 


High 


Moderate 


Snphasis on language 
training - 


federate 


Moderate — » 


ruilosophical 
orientation 


Cognitive 


Cognitive and socio-erootiona] 


Parental ~ 
Involv^n«nt 


>ligh 


Moderate 


Number of hours of 
intervention per 
year 


240 hr./yr. 


7A nti/yv 


Hours per year x 
adult-child ratio 


100 


2A- 


Child-child ratio 


5 for summer school 
0 for home visits 


0 



* See lapt nape of Table 19 for key to Group Codes by project site. 
** These variables are taken from Gordon or Goodson and Hess. 
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Karnes 


1 

Miller ' 


Age at beginning of 
intervention** 


4 yra. 


4 yrs. 


licngth of intervention 
in Years 


1 yr. 


4 yrs. - intervention & regular 
school; i> yrs. - intervention & 


Length of intervention 
in no/yr. 


< .8 oo/yr 


9 mos/yr 


Goals stated for pcrents 
and /or children** 


' Children 


Children 


Geographic location 
by HEW regions** 


Region 5 
(Midwestern) 


Region 4 
(Southeastern) 


Child Condition at 
Entry** 


Normal 


Normal 


Delivery systerja*- 
Site 


Center 


Groups 2,3,4 « center 

1/2 of group 1 « center, 1/2 of 

group 1 « coaibiaAtion ' 


Adult-cnlla lALlo'"' 


*n-niiria*l ? 3 " 1—5 

group 6 « 1-6 
group 7 « 1-3 


Grv/Ups 1,2,3 ■ 1-8 
group 4 " 1-? 


Staff Qualifications 


Professional & 


Professional and paraprofessional 


Staff training 


In-service 


Pre-service and In- ^rvice , 


Program goals 


Group 1 - language GrojJ) 1,2 - cognitive, J 
cognitive, affective language, achievement motiVationL 
group 2, j - cognitive group 3 - cognitive, stnsory, \ 
group & - co^irive, dal?y living* character 
8elf-develop5*si3t group 4 - congitivc, enotional, 
Rroup 7 - language; social, physical 
cogn^.titfe, affective 


Dc^gree of structure 
in teaching activities 


Groups 1,7 - minimal 
erouod 2-3.6 - hi«h 


Groups 1,2,3 - high 
group A - moderate 


Sper-iricity In 
instruction by parents 
or teachers 


GiToups 1,7 - moderate Groups 1,2,3 - high 
groups 2,3,0 - high group 4 - low 


Eir/phasis on language 
training 


Groups 1,2,3,7 - 
high , 

group 6 - low 


Groups 1,2 - high 
group 3 -vlow 
group 4 - moderate 


Philosophical 
orientation 


Group 1,7 - 
ttaditional 
gzoups 2,3^6 - 
b«?haviorial^ ^ 


Groups 1,2 - cogniti^'e, behavior ial 

gL'oup 3 - cognitive, personal; 

group 4 - traditional socio/emot^onal 


Parental 
Involvement 


Moderate 


Groups 2,3,4,& 1/2 of 1 - minimal; 
1/2 of group 1 - high 


Number of hourr of 
intervention per year 


jbU hr/yr 


Vxroup i - 1206 hi/yr 
groups 2,3,4 - 1160 hr/yr 


Hours per yekr x adult- 
child ratio/ 


• 72 


Groups 2,3& 1/2 of groyp 1 - 146.25; 
group 4 - 166.14; 1/2 of group 1 - 
182.25 


Child-child ratio 


5 


Groups 1,2-8 
group 4-7 
grr^up 3-2 

V 



* See last page of Table 19 for key to Group Codes by project site. 
"** " ThWe"varlable8 are taken from Gordon or Good son andjless. 
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Levenstein 


Palmer 




Age at beginning of 
Intervention** 


2 yrs. 


Groups 1,2,6,7 
Groups 4,5 


2 yrs^ 
- 3 yrs. 


Length of Intervention 
In years 


* Groups 1,16 » 9 mo. 
Groups 5,7,8,12,14 
15-1 yr,, 9mos, 


Groups 1,2,4,3 
Groups 6,7 «• 2 


- 1 yr. 
yrs. 


Length of Intervention 
in mo/yr. 


7 mos/yr 


8 mos* 




Goals stated for 

Parents and/or Children** 


Parents & Children 


Children 




Geographic location by 
HEW regions ** 


RegiOii 2 
(Northeastern) 


Region 2 
(Northeastern) 




Child conditio^ 
at entry** 


Normal 


Nortoal 




Delivery system** 
Site 


^ 

Home 


Center 




Adalt-Chlld Ratio** 


1-1 


1-1 




Staff Qualifications 


Professional » 
Volunteer, ^ 
Parapro f esslonal 


Professional and para- 
professional 


Staff training 


Levenstein Pre- 
service and In- 
service 


Palmer In-service 


Program goals 


Cognitive,. affective, Cognitive 
language 




Degree of structure 
in teaching activities 


Rfgh 


Groups 1,4,6 
.^groups 2,5,7 - 


High 
low 


Specificity in instruction 
by parents or teachers 


High ^y. Groups 1,4,6 - 
V f ' ^U Groups 2,5,7 - 


High 
low 


Emphasis on language 
training 


Hi^h 


Moderate 




Philosophical orientation 


Cognitive and 
Traditional socio/ 
emotional 


Cognitive 

\^ 




Parental involvement 


High 


Moderate 




Number of hours of 
intervention per year 


46 hr/yr (long year) 
7 hr/yr (short year) 


45 hrs. 




Hours per year x 
adult-child ratio 


46 long year 
7 short year 


45 




Child-child ratio 


0 ' 


.1/0 





* See last .page of Tabic 19 for key to Group Codes by project site, 
** These variables are taken from Gordon or'Goodson and Hess, 

N 
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Weikart Perry 
Preschool Project 


Weikart 

Curriculum Demonstration 


\ Voolman 


Ago at Begixmi'ng of 
Intervention ** 


* Group 1-3 yrs. 
Group 2 4 yrs. 


3 yrs. 


4 yrs « 


\ • ■ 

^ten^th of Intervention 
Years 


Group 1-17 mos. 
Group 2 " 8.5 mos. 


> 

2 yrs. 


2 yrs. 


Leng^ of Intervention 
in lao/yr. 


8.5 mos/yr. 


8.5 mos. 


12 mos. 


* \ 
Goals stated for 

' parents and/or' 


ChUdren 


Children 


Children 


Geographic locatJLon 
by H3EW regions** 


Region 5 
' (Midwestern) 


Kegioh 5 
(Midwestern) 


— Regluu 2 

(Northeastern) 


Child Condition at 
Entry** 


Functionally 
Mentally Retarded 


Functionally 
Mentally Retarded 


Educably Mental 
Retarded 


Delivery System** 
Site 




Combination 


Center 


Adult-Child 
Ratio** 


Home: 1-1 
Center: 3-6 


Home:. 1-1 
Center: 1-5 ^ 


r. 

' 1-15 



Staff 

Qualifications 


Frotessionaly 
para-professional 
and volunteer 


Professional and ' 
paraprofesslonal 


Professional and 
Paraprofesslonal 


Staff Training 


Weikatt Perry 
Preschool In- 
Service 


Wekart Curriculum 
Demonstration In- \ 
SpttvIpp 


Woolman In-bervlce 


Program Goals 


'cognitive, iaijiguage 
affective 


Cognitive; 


Languu£»3» Cognitive y 
Social, Achievement 
Motivation, 


J . 

Degree of structure 
In teaching activities 

\ 


Moderate 


Groups 1 & 2 r h'lgb 
Group 3 - low ; ^ 


Moderate 

(i/2 high, 1/2 low) 


Specificity tn 
instruction by parents 
oi: teachers 


Moderate 


Groups 1 & 2 - high 
Group 3 - low ' 


Moderate 


1 

Emphasis on 
language training 


Moderate 


Groups 1 & 3 - high 
Group 3 - moderate 


High . ^ 


Philosophical 
Orientation 


Cognitive 


Group 1 - Cognitive 
Group. 2 - Behavioral' 
Group 3 - Traditional 


c> 

Cognitive, Social 


Parental 
Involvement 


High 


High 


Moderate 


Nuabervof hours 
of Intervention 
per year v 


504 hrs. 


450 hrs. ' 


600 hr^./yr. 


'iJUours per year 
X adult-child ratio 


128.7 


198 , 


39.6 


Child-child ratio 


1/5 


1/5 In center 
y 1/1 In home 


1/15 



* See last page of Table 19 for key to Group Co3es by project site. 
** These variables arc taken from Gordon or Good son and Hess. 
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We^rt Zlgler 
Carnegie Infant Study 




>ti^p|^^Al^.^Aeglnn].tl9 oi 


c 

Of t % vr 1.x ]iKio« 


4 yra . . ^ ^ 


'sllan^Clt^oi^ Xntarventio*! 


16 nos « 


5 yrs» for foilow-through 
^roup- 


Iiingth of Intervention 


12 nos* 1st year 
ii tnfjA . 2nd vear 


9 mos. 


Goals?* ta ted for ' 

;^i(^'ilir«n** 


Both parent and 


CSiildi'en 


'HWYrcgiona** 


(Hldvestem) 


Region 1 


Entry** 




Nornal 


t|5ita^ . 


Home f 


Center 


ratio** • 


*• 


1-5 for Head Start 
1-10 for follow .Through 


r>cair 

Qualifications 


r^t0£CO9 4.Vlt<tA 


Professional and Para— 
professional \. 


ocazr iTaxmng 


In-Service 


Zigler In-Service 




\ < 

^^JjsUA !• AVC y kW^bltw^ 

Teacher 


Cognitive, Socil^Lt Emotional) 
Physical 

'' ^ 


Degree of structure 

All I.CCtl.llXll|^ ttUL aVaI. aCo 


Moderate > 


Low - Head S%|^ 
Moderate - Follow Througk 


1 

specificity in instruct 
instruction by parents 
9r teachers 


Moderate 

/ 


federate - Follow Through 
Low - Head Start 


Eisphasls on langus^e 
. training 




Moderate 


Philosophical 
Orientation 


* Cognitive 


Traditional , Socio-Emotional 


Parental 
Involveaent 


High 


Moderate 


Nuaber of hours 
of intervention 
per year 


A8-72 hi;s/yr. 


1260 hrs./yr. 


Hours per "year 

X adult-child ratio 


72 


108 - He Ad Start 
126 - Follow Through 



Child-child 
ratio 



1/0 



1/5 - Head Start 
1/10 - Follow Through 



** These variables are taken from Gordon or Goodson and Hess. 
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Table 21 
cont. 



Beller 



Deutsch 



Group Codes for Program Variable Descriptions 



Group 1 « Entered nursery school at 4 

2 « Entered kindergarten at 5 

3 « Entered first grade at 6 



All groups the same 



Gordon 



Group 1 ^ Experimental first, second an<i- third years^ 

2 = Experimental first and second years, control third year 

3 = Control first year, experimental second and third years 

4 = Experimental first and third years, control second year 

5 =» Experimental first year, control second and third years 

6 =5 Control first and thix3 years, experimental second year 

7 - Control first and secbnd^.'Jrears, experimental third year 

8 = Control all three years, ^ 



Gray; Early Traininfe Project ' 



Group 1 =5 Experimental at age S.S^years 

2 a Experimental at age 4,8 years 

3 =* Ra'dom local control". 

4 = Distal control 



Gray: Family-Qrientad Home Visitor 



-Karnes- 



Group 0 
1 
2 
3 
4 

Group 1 
2 
3 
6 
7 



Control .> 
Extensive home, visitfhg for 2 years 
Extensive home visiting for 1 year 
Materials only for 2 years 
Materials only for 1 year 



Traditional Curriculum 
Bere iter-Engelmann 
GOAL program 
Moritf'essori 

Community Integrated 



Levenstein 



Group 1 
5- 
7 
8 
12 
14 



1 year treatment 

2 years treatment 

1 and 2 years D 

1- and 2 years D Materials only* 

2 years materials only 

1 full year, 1 short year 
1 full year, 1 short year, materials only 



15 

16' = .1 year control (visitor) , 1 year treatment 
17^=Xontrol, 1967 (2 & 3 yrs, old) 

18 Control, 1967 ( 4 yrs, old) 

19 = Control, after only 
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TaW 
cont. 



Miller 



GrouT) 1 = DARCBE 

2 = Bereiter-Engelmann 

3 = MoRtessori 

4 = Traditional 

5 = Original Control 



Palmer 



Group 1 = Training at 2 years for one year, concept training 

'2 = Training at 2 years forgone year, discovery training 
Z = Control 

4 = Trained at 3 years for'^jne year, concept training 

5 = Trained at 3 years for one year, discovety training - 

6 = Training-^at ages 2 and' 3, concept training 

V 7 = Training "at age s'' ^ and 3, discovery training 



Welkart Perry Preschool^ Project 

—————— o 

^ Group 0 V Control ^ . i 

1 = Experimental from ages ^-5 

2 » Experimental from ages 4-5 

Weikart Currlculum'^emonsJJ^^ion Study 

V Group 1* = Cognitively-orientev^c&rriculum 

2^- Bl^reiter-Engelmann 

3 = Traditional 



Weikart Carnegie Infant Study . 

Group 1 = Experimental 
2 = Control 

4 ^ Post-tested only controls 



Woolman 



All groups the same 



Zigler 



Group 0 = No follow-through 
' 1 = Follow-through 
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Table 22; Z-Score Computation for Be tve en-Pro gram 
Variable Categories 



• Variable 



Geographic Region 



• Child Condition, at Entry 
*f 

Target Group 

(Goals Stated for Whom) 

' Le^^th Oifr^nterventlon 
iiv Mojrt ha/ Year's 

' ' . • ; 

" Delivery System 



Staff Qualifications 



Child Group Size 
Emphasis on Language 



Philosophical Orientation 
of Program 

Adult-Child Ratio 



Teaching Structure 



^ Contrast 
Northeast vs. Southeast' & Midwest 
Nprtheast and Midwest vsi Southeast 
Normal vs. Retarded^ 

Children Only vs. Parents and 
Children 

r 

Over^9 Months vs. Less Than 9 
Months 

Home vs. Center and Combination 

Combination vs. Home and Center 

Center vs. Home and Combination 

Paraprofesslonal and Volunteer 
only vs. Paraprofesslonal and 
Professional/and Professional 
only ♦ 

Professional only vs. Parapro- 
fesslonal, Professional and 
Volunteer 

On' vs. 5 or more chlldi:en 

Medium vs. High and Low ^ 

High vs. Medium and Low 

Low vs. Medium and High 

Cognitive and Behavioral vs. 
Traditional 

1:1 vs. 1:1 and 1:>1 • • 

1:>1 vs. la and 1:>1 

High vs. Medium and Low 

Medium vs. High and Low 

Medium and High vs. Low 



.534 

,5652 

.1323 



7P 

.5962 
.5754 
.8966 



.1646 .8728 

» 

,.7478 " .4592 

- .0765. .9442 

1.5637 .1188 

-2.0850 , .0376* 

.6034 w .5486 



1.0340 

- .5785 
.9763 
1.2690 
-1,4352 
.0625 

.'3101 
-1.4942 
1.7477 

.3031 
-3.2088 



.3030 

.5686 
.3320 
.2076 
.1528 
.5352 

.7566 
.1-362 
.0818 
.7642 
.0014* 




Var; 



Parental Involvement 



Staff Training 



intensify of Inter- 
vention 

■Adult Intensity Ratio 



Contras t 
Medium and High vs. Low 

f 

High vs. Medium and Low 

-3 

Pre-service and. In-service vs^i 
In-;servi(;e Only 

Less than 100 -c per year v^. 
More thart 100 hours p^r year 

Less than 50 Potential Adult 
Hours of Contact vs. More 
than 50 Hours ' 



2. .5547 
•1.2329 
-2.082Q 

-1.6199 

.4196 

♦ 



.•0118* 

.'2186 

.0376*- 



.1074. ^^1 



.6744 



uncorrected p-values < .05 
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PART VI 



CONCLUSIONS AND IMPLICATIONS 



* If one accepts all of the assumptions inherent in the analyses, then 



i^;5 X the following coricluL»ions seem reasonable: 



1) Infant and preschool services improve the ability of low income 
children to meet the miniir T requirements of the schools they 
enter. This -^ef feet can be manifested in either a reduce^ 
probability of being assigned to ^special education classes or a 
reduced probability of being held back in grade. Either 

% reduction constitutes a substantial cost reduction for the school 
system. 

2) Low ilSrome adolescents who received early educat:ion rate their 
competence in school Higher than comparable adolescents who did 

not have preschool education. 

3) As measured by the Stanf ord-Binet and the WISC tests preschool 

programs produce a significant increase in the intellectual 
functioning of low-income children at least during the critical 

years of the primary grades in school. 
Probably the most important finding is that low Income children who 
received early education are better able to meet the minimal requirements 
of their school. Results on IQ tests indicate that this may be due to an 
'increase in intellectual skills which lasts through the very important 
primary grades in school. Additionally one might hypothesize that the 
reduction in rate of assignment to special education or of being held 
back in grade is due in part to increased parental concern and competence 
to deal with the school system - an indirect effect of parental 
sensitization by the ^.preschool experience of their children. This 
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hypothesis is certainly supported by the fact that all of' the pro^-ee^ which 
found significant effects on special education either were home visiting 



programs or had some visiting components. The two projects which found 
significant effects on grade failure had somewhat less^« degrees o,fj>arental 
involvement. At this point, then, the evidence does not dit*ferentiafce 
between the relative contribution to the effects on school performance 
of increased intellectual skills in the child and^increased parental 
concern with the child's learning. The positive effect of early education 
on school performauce is now fairly well established, but the mechanisTr. . 
which it has this effect is still open to conjecture. 

The evidence also suggests that, uith respect to school performance, 
there is as of now no indication of a "magic age** at which early 
intervention is most effective. Projects having significant effects *on 
assignment to special education were Gordon (education from birth to 
two years of age). Gray ETP (four and five years jof age) and Levenstein 
(two and three years of age). Projects having significant effects on 
>rade failure were Palmer (two and three years or age) and Woolman (four 
years of age) » Further, programs which had significant effects ranged in 
duration from eight months (Palmer) to up to three years (Gordon) . The 
most that can be said is that, at this point, there is no indication of a 
most effective age or length of intervention. However, given the 
relatively small number of programs investigated and the relatively 
large nu.nber of confounding factors (geographic region, cohort, school 
policy, etc.), it is possible that such magic points exist, but are 
not discoverable without a more rigorous, large scale experiment designed 
specifically to answer those questions. 
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— In sum, .the most important concluston which has been reached to date 
from this body of dat;a is that well-run early education programs can in 
some way improve, the ability of low income children to meet the requirements 
of their schools. 

B. Implications and Recommendations for Na'^tional Policies and Programs 

In examining both the statistically significant findings, and the trends 

which appear across these studies, certain policy implications seemed clear* 

to us; J ^ile further analyses and other data will be necessary to fully 

document^these implications, we felt it important that they be listed now, 

even in their somewhat tentative state/ ^ 
• 1. Day Care * r 

These findings indicate that the failure to require a deliberate, 

well planned curriculum for young children in federally supported ^^ay care 

programs is likely to cost more money in later special education expenditures 

than would be saved in day care costs. We recommend that the educational 

requirement not only be restored to the Federal Requirements, but should 

be made explicit. 

2. Program Delegation 

I-Jhile it is difficult to generalize across all public schools, 
in none of the public schools who sponsored preschool programs included 
in this study were parents involved as teachers of their :)wn preschool 
children. Neither did they mount home--based services, nor accept 
children under four years of age. Further — there are exceptions 
most public schools have rigidly defined and highly 'structured curricula, 
and the, typical supervisory structure of a public school does not permit 
very much leeway in structure. The tendency to adopt uniform policies 
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and philosophies in districts mitigates against -the capacity of many 

'school districts to be responsive to individual and subcultural needs in the 

way a f if teen-ctii^^ead Start site can. ' ' „ * 

Until further ^research data are available, it would seem imprudent 

to^^assign. Either day care or Head Start responsibilities solely to school 
'districts in general. In some communities the school could be the optimal 
site. But respect for individual differences in children suggests that 
many, kinds of auspices are a safer choice than is delegation of such , 
programs to a single type of auspice:*" 

3. Age, Duration, and Type of Curriculum 

The data in this' report do not clearly indicate thdt either a 
particular age, or a particular length or t>pe of preschool experience is 
optimal for all children. Future analyses^ of these data may assist in these 
policy areas. 

' 4. Head Start 

We see three major implications for Head Start programs which flow 

r 

from these preschool findings. 

a. A large national random sample of new Head Start enrollees and ^ 
their parents (or whole sites) should be identified so that baseline data** 
could be collected prior to the program experience. We believe that fears 
of rejection of sucl. 'ata collection at entry by parents are overblown, 
that most parents are accustomed to an intake procedure for public ^ 
services. Without such baselines. and an initially tight reseavch design, later 
evaluations of typical Head Start programs are not possible. 

* These experiments were carried out under various auspices ~ public schools. 
Head Start Centers, independent agencies and universities. Quality control 
may be more important than ausoice. 

We can maki? suggestions as to the implementation of this recommendation. 
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b. A careful review of the extent to which structured curricula 
are actually being used in Head Start programs should be ^carried out. Furthe 
steps may need to be taken to ins're^th^t deliberate learning goals are .w- 
identified and teaching str-ategies implemented, * 

c. The establishment of PCC's as a demonstration program a decade 
ago, and of Home Start some seven years ago, may have be^,n necessary to try 
those ideas out. To keep these services separated from •'regular" (i.e.; 
center-based) Head Start operations seems no longer justified. The evidence 
suggests that all Head Starts be encouraged to adopt PCC and Home-Start 
services (and age groups) as part of their regular programs, to obtain the 

^benefits of earlier and mixed-locu^ intervention-. The s^arate PCC's and 
Home Start Centers could be converted into training sites during the 
period of introduction of their services^ into Head Start programs, and then 
could be expanded in scope to become "regular" Head Starts. 

Finally, and recognizing the self-serving nature of this recommendation, 
we think that this study provides a reason why Head Start re<^earch funds 
should be increased, with a greater portion of those funds reserved for 
investigator-designed rather than contract-designed studies. 
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PART VTI , _ 

♦ 

FUTURE TASKS 

As rapidly as resources will. permit, we plan to comp^lete analyses o£ 
these d^ta to^ address questions ia the following areas: 

A. WISC-R Subtest Scores and Patterns 

Is there a different pattern among sub-test scores for the control 
group compared to the program group? Millar has a sample of fourty-four 
children who took the Stanf ord-Binet as well as the WISC-R in the spring 
of 1977- The sample was stratified by original Head Start program or con- 
trol and by sex^ in so far as was possible. We plan to investigate' the 
cotiiparability of the two IQ tests. 

B. Achievement Tosts 

We have 3,12,9 test records for the 1,115 subjects. The tests were 
given in gtades one through twelve, but our results were primarily for 
grades three, four, five and six. There are 200 records for grades seven 
and eight and 100 for grade nine. The approximate N's per test ai9.: 
Gates MacGinitie - 100; California Achievement Test - 200; Comprehensive 
Test of Basic Skills- 400; Iowa Test of Basic Skills - 400; Wide Range 
Achievement Test - 400; Metropolitan Achievement Test - 600; ^nd Stanford 
Acheivement Test - 600. There. are grade norms for 1,349 records using 
primarily national norms. This data has not been analyzed yet because of 
the very complex transformation problems involvec^.. We will investigate 
several possible approaches to these analyses. 




^ C. Special E<iucatlo|i and Retention 

Special education and retention as main effects are establishe<i but we do' 
' not yet know anything about the pathways to those outcomes and what ef- 
fects different mental abilities, family structures or sex. for example, 
have on those outcomes, .The effects of "mains t reaming" under PL-94-1A2 
may mask these differences in future studies, making replication with a 
new saniple very ^^ff icult, 
D. Parent aSid Youth Interviews 

Interview responses are yet to be analyzed in depth. In the area of 
values, self-esteem and social perception, we have indications of some 
provocative results • For example, using Youth Interview re$ponses to 
question j^l7, "What is the worst trouble you We ever been in?", 20% of 
the control group compared to 14.9%" of the program subjects mentioned 
police-involved incidents, drugs, thefts, or being expelled or suspended. 
.This difference appears to be the case for both control boys* and girls. 
The program group also appears more likely to have higher job aspira- 
tions. Both these results, along with the dropout findings discussed in 
the analysis section, are only preliminary findings. 

iffie Consortium members have agreed to pool efforts to investigate 
the extent to which program and controls are known to state Child Welfare 
Systems. This investigation is in its preliminary phase. 
£• Who Benefits? 

The basic practical question for which the data will soon be on hand re- 
mains a central concern: 



129 



What kinds of children 
* from what kinds of families 
benefit most ' . , ^ 

from what kinds of intervention ^ ^ 
at whatj points - and, with what duration - in their early years? 

F« Developmental Questions 

Aside from the effects of early intervention, what can these data tell us 
about cognitive and emotional development in children from low income fa- 
milies, during the school years? 
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APPENDIX A-i 



INTRODUCTION 



' Although this constitutes our final report to 0£D on research 

c^.dueted with their support in FY 77, it does not constitute the final 

^ work we intend to accomplish. Some data is still being collected, and we 
"^^^.plan to undertake a number of additional analyses. Because the co8ts for 
this study were necessarily unpredictable (i.e., the number of subjects 
that- could be found was not predictable, nor the length of time 
necessary to gfet school district clearances), the spring meetings of the 
Consortium were canceled so that the funds could be used for data col- 
lection. ^ 

As of August 15, 1977, salary moneys were fully expended. A grant trom ^. 
the Hewlett Foundation will permit some continuity until new funds can be 

r 

pbtained. This will permit coding of the additional data yhich will 
arrive, and com ^^tiop of several analyses now in progress. These will be-^ 
submitted as separate supplements ; but are not crucial to the major 
purpose of thi/s study. 
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CONSORTIUM MEETINGS • 



A preliminary Consortium meeting sponsored by the Social Research 
Group of George Washington University was held in Washington on July 9> 
1975. Here, the interested investigators met to discuss the iscues involved 
In undertaking a pooled longitudinal research effort. Discussion centered 
on definitions of developmental continuity and on the policy implications 
of various approaches to the research. 

"The Education Commission of the States offered to sponsor the sub-* 
sequent Consortium effort^^ At a second meeting, participant researchers 
agreed as an initial step to make all their original and follow-up data 
available in detail for the purpose of join', analysis • Additional tasks, 
svch as the production of a position paper and an inventory of available 
data, wera agreed upon as priorities. 

A subsequent meeting was held in Washington on October 3, 1975* 
At that time, Dr, Palmer related the issues of his paper, "Has Compensatory 
Education Failed?" f:o the current educational climate ?imong public and 
private decision^ makers. Dr. Lazar's draft paper on research issue's was 
also discussed, and plans were made for identification of available data. 
Dr. Lazar was delegated as chairperson for the study. ^ 

A series of regional subcommittee meetings were held late Tn 1975 
and early in 1976. Of primary concern was the selection of instruments 
to be used by each of the programs involved in the study. 

A meeting in March, 1976 in Gainesville firmed up the study design 
and budget, and specifications for proposals w^th which to seek support 
for the longitudinal research. The initial interview forms were approved 
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for pretest. 

Following award of a grant from the Office of Child Development, ' 
a meeting was held in conjunction yHth che October, 1976 NERA conference 

in Ellenville, New York. Discussion centered on the design and use of 

»» 

the various instruments. Issues such as the analysis, of SES, attrition 
problans, and comparability of IQ and achievement scores were brought up. 
Each project presented a progress report on their data , collect ion ef- 
forts. Agreement on variables to be measured was reached, and a tentative 
production schedule was established. • ' 
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1'^- ' . / APPENDIX, A-3 \ 

PRESENTATIONS Ql9m 1976-1977 
' — —y- ^ 

Presentatiohs by Consortium members were given at the meetings of the ^ 

/ ' / • 

American Psychpligical Association (September, ^1976); No/rtheastern Educa-- 

cational Reseaf</h Association (October, 1976); National^ Association for the 

Education of Ycjdng Children (NovGmber, 1976); Amer4.can Association for the 

-Advancement of Science (March, 1977); American Orthopsychiatric- Association 

C — 

.(April, 1977); American Educational Research Association (April, 1977); and 
Office of Child Development Conferencis (May, 1977). Papers presented at these 
meetings are^ listed .below, and are attaclied in Appendix C. y 

Brown, Bernard, ^Methodological Issues in Comparing Early Intervention 

Programs?' (Symposium)*. Symposium Participants: Irving Lazar, E. Kuno ^ 
Beller, Susan Gray, Ira Gorxion, Victoria Seitz, presented at Northeastern 
Educational Research Association, Ellenville>, New York, October, 1976. 

Brown, Bernard, "Sleeper Effects from Early Intervention Programs." Synjposium 
Participants: tynthia Deutsch, Merle Karnes,. Louise Miller, Francis 
Palmer, Sheldon White, presented at Northeastern Educational Research 
Association, Exlenville, 'New York, October, 1976. 

^Hubbell, Virginia Ruth, "The Developmental Continuity Consortium Study - 

Secondary Analysis of Early Interventidn Research," presented at the 
" American Association for the Advancement ot Science Conference, Denver, 
March, 1977. 

Hubbell,^ Virginia Ruth, "Differential Effects of Early Childhood Intervention 
Programs," presented at the American Orthopsychiatric Association 
Annual Meeting,. New York, April 16, 1977'. ' 

Karnes, M.B. , "The University of Illinois Study of the Differential Effects of 
Five J^reschool PrjDgraras", presented at the Annual Meeting of the Ameri- 
? can Educational" Research Association, New York', April, |L977. 

' Lazar, Irving, Chairman, Symposium: "Early Intervention: How Well Does It 
Work?" Participants: Francis Palmer, Victoria Seitz, Robert Hess, 
Discussants; Urie Rronf enbrenner , Marshall Smith. American Psychological 
Association, Washington, D.C., September, 1976. 

Lazar, Irving, with Virginia Ruth Hubbell, Harry Murray, Marilyn Rosche, 

Jacqueline Royce, "Preliminary Findings of the Developmental Continuity 
Longitudinal .Study," presented' at the Office of Child Development- 
"Parents, Children, and Continuity" conference. El Paso, Texas, 
May 23, 1977. 

Miller, Louise B. , "Differences in Process and Product in a Four--Program 

Comparison: The Louisville Study," presented at the Annual Meeting of. 
the American Educ^^tional Research Association, New York, April, 1977 \^ 
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Murray, Harry William, "Early Intervention in the Context of Family Charac- 
teristics," presented at the American Orthopsychiatric .Association 
Annual Meeting, New York, April 16, 1977 • 

*Palmer, Francis H. , "The Effects of Early Childhood Intervention", present- 
t ' . ed at the American Association for the Advancement of Science Confer- 
ence, Denver, March, 1977 

Palmer, Fxancis H. . "The Effects of Minimal Early Int^^rvention on Subsequent 
Id scores and Reading Achievement," presented at the Office of Child ^ 
Development "Parents, Children, and Continuity" conference. El Paso,, 
Texas, May 23, 1977. 
Palmer, Francis H. . "The Effects of Early ^kldhood Educational Interventiori 
• on School Performance," prepared for the President's Cocm.ission on 
Mental Health, July, 1977. 
*Seitz Victoria, "Long-term Effects of Intervention: A Longitudinal Jnvesti- 
! gacJon!" ;res,nted at the American Association for the Advancement of 
■ a science Conference, March, 1977. 
Weikart. David." "Can Preschoox Make a Lasting Difference?" pres^nt^d at 
Of{tc4^ of Child development "Parents, Children, and Continuity 
conference. El Paso, fexas. May 23, 1977. 

♦ 



* Included in Brown, B. (Ed.), Found; Long Term Gains from Early 
^ Intervention , Westview Press, Boulder, 1977 (Copyright, American 
Association for* the Advancement of Science). • * 
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APPENDIX A-A 
S TATUS BY INSTRUMENT 

The data collected from six instruments comprise the follow-up data 
b'ase. Data received at Cornell before July l/l977, on four instruments 
(Parent and YoOth Interviews, School Recorf^ Forms and WISC-R scores) wre 
coded, keypunched, cleaned and merged with "original" (pretext and earlier 
posttest) data to form a SPSS Consortium Master File. This Master File 
is now on compt >r tape and was used for the analyses reported in this 
paper. All Woolman data, however, are in a separate file on computer tape. 
Also, Ziglcr'c earlier ; and post test results are in the Consortium 
Master File, but the latest posttest data are on computer cards. Data on 
the pther two instruments (AcTiievement Tests and School Supplements) have 
been keypunched and cleaned but are not yet included in the Consortium 
Master File. Table A-1 shows the number of cases received from each 
project site by instrument as of September 30, 1977. Table A-2 shows the 
number of cases in the SPSS Master File used for this report. A more 
complete discussion of the current status of each instrument follows 

below. / ^ 

1. Par nt c^nd Youth Interviews , ^ 

For this report/ the Consortium Master Filt: includes 871 Parent 
Interviews and 773 Youth Interviews merged with ,the pretext and earler , 
posttest data. Tn addition, the separate Woclman file (which had no earlier 
posttest data) included fifty-four Parent and ninety-seven YouLh Interviews. 
Since the .;uly 1 deadline, thirty-two additional Parent Interviews and forty 
additional Youth Interviews have been code J, keypunched, cleaned and are 
' ready to add to the Master File. Interviews continue to arrive at Cornell 
(primarily from Seller and Gordon sites), but have not yet been coded or 
keypunched. This group includes an additional t-oirty Parent and 

13/ 



sixty-two Youth Interviews. In addition* 185 Zleler scores wllJ be 

♦ 

addled to this total, -The Zlgler site Interviewed their subjects as they 
reach^ seventh and eighth grade using thelr^ own Interview, Four or five 
of their attltudlnal questions correspond to questions on the Consortium 
Youth Interview, These data, which are on compnter cards, ^wfere sent to 
Cornell along with PPVT and Achievement scores for those cases. As shown 
In Table A-1, the total number of Consortium Parent Interviews received 
by September 0 was 987, The number of Consortium Youth Interviews ^^eceived 
was 971 plus 185 Z gler interviews, making a total of 1156. These totals 
are approximate. It is to be noted that all projecta %/ith the exception 
of Zlgler interviewed their subjects in I '976-7? year. 

Other family data yet to be keypunched ^nd added to the file are 
Beller's retrospective data. These demographic data are to be included 
in the pretest ("original") part of the Consortium M*?ster, File, 

2, School Record Form 

Data on special education and retention for 1529 cases are Included in 
this report. As discussed in Part II, Methodology, this information came 
from several sources. The Seller site has sent an ^ditlonal thirty-six 
School Records not yet keypunched, As shown in Table A-1, the September 30 
total is 1578 School Records, 

3, Wecshler Intelligence Scales 

Elgh*- project sites reported Webchler scores. Analyses of results 
for six projects ara included in this report,"* The seventh site, Karnes, 
has no untreated control group. The Consortium Master File, as of July 1, 
includes IQ scoi'es for 630 cases. An 'Additional ninety--five from the 
Woolman site are in a separate file. The fifty-seven WAIS scores received 
from the Deutsch project have be »n keypunched and cleaned and are ready to 
merge "with the Master File. Zlgler sent 185 Peabody Pict:ure Vocabulary Scores 
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on computer cards which can be included in future analyses. As shotm in 

Table A-l the number of cases with follow-up post test IQ scores is approximately 

979. The Gordon and Seller sites are currently administering WISC-R tests 

that the 10 sample Is expected to be close to 1000. (See Part II; 
*>ata Collection Methodology for additional detail on which sites administered 
Wise or Wise R tests and how old the subjects were). In order to investigate 
the comparability of the two IQ tests, the Miller site sent a listing of 
IQ scores for a samp]? of forty-four children who were administered the Stan- 
ford Binet as well as the WISC-R at this pobttest. Karnes is adtninistering both 
tests to her entire sample. 



4. School Supplement 

Three project sites chose to collect supplemental school data on attendance, 
marks, etc. A total of 219 cases were received and keypunched. Approximately 200 
ca8e»-..fp^ the Woolman site also have these supplemental data available. 
None of these d^^ta havt^ bRt.i cleaned or analyzed. 

5. Achievement Test Scores 

As shown in Table A-1, one or more Achievement Test Scores for 1333 
subjects have been received and kaypanched. These data have not been merged 
with the Master File, for sev^ral reasons. First of all they have not yet been 
cleaned. la addition, problems merging with the SPSS Consortium Master 
File have not been worked out. Tlie data for an SPSS file must have exactly 
the same numbei' of cards for each case. For the achievement test data, 
^ach case has a different number of cards depending on how many achievement 
test scores are reported. The preliminary analysis on which tests were 
given and at which ages is discussed in Part VII, Future Tasks. 

13:J' . 
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Table A-1:a Number of Cases Received by September 30, 1977 
for Each Instrument by Project Site 



School 



School 



Project 
Site 


Parent 
IntervievTS 


Youth 
Interviews 


Record 
Form 


Ach't. 

Testis 


Record 
Form 


IQ 

Scores** 


Any 
Data 


Beller 


93 


93' 


77 


64 


64 




106 


Deutsch 


53 


58 


33 


21 




57 


66 


Gordon 


107 


76 










101 


Gray 


72 


69 


74 


72 


7A 


72 


77 


Karnes 


120 


114 


107 


AA 

99 






1 91 


Levenstein 


98 


75 


120 


116 




76 


I8f 


Miller 


141 


141 


139 


134 




141 


141 


Palmer 


143 


144 


209 


197 




132 


228 


Weikart 


106 


104 


123 


96 




110 


123 


Woolman 


54 


97 


511 


349 


200 


95 


611 


Zigler 




185 


185 


lj5 




185 


185 


Totals 


987 


1156* 


1578 


1333 


442 


979 


1945 



Note: These totals are approximate. See Appendix A-4 and Part II (Data 
, Methodology) for additional detail. 

* Total includes 185 Zigler cases who did noL have Consortium Interview. 

** Scores include WISC-R scores for Gray, Karnes, Miller, Palmer, Woolman; 
Wise scores for Levenstein, Weikart; 
WAIS scenes for Deutsch; 
PPVT scores for Zigler. 

+ Any data is defined as number of cases for which data on at least one 
instrument were reported. 
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Table A-2: 


Number of 


Cases in July 1, 


1977 Coinputer File 


for Eaclj 




Instrument by Project Site 








•Project 
Site 


Parent 
Interviews 


Youth 
Interviews 


School 
RecC)td 
Form 


Wise 


• 

Any 
Data* 


Belier 


78 


59 


f -• 
41 


— — 


86 • 


Deutsch 


47 


57 


33 





63 


Gordon 


96 


42 








96 


'Gray 


. 72 


69 


74 


' 72 


77 


iKames 


120 ' 


114 


107 


112 


121 


Levenstein 


^ 84 


59 


120 


76 


186 


Iflller 


1 A1 

J-H J. 




139j 


141 


141 


Palmer 


127 


128 


198 


119 


221 


Weikart 


106 


104 


123 


. 110 


123 


Wooltnan 


54 


.97 


' 509 


95 


185 


Eigler 






185 




611 


Totals 


925 


. 870 ' 


1529 


725 


1910** 



* Any data is defined as number of cases for which data on at least one 
instrument were reported for this analysis, * 



'** Total includes 1114 cases in merged file; Woolman and Zigler data are 
on separate data files. 




Ar?ENDIX B; TECHNICAL SUPPLEMENTS 
APPENDIX B-1 

SAMPLE SELECTION AND Af.SIGNMENT , 

Perhaps the most critical question which can be asked about a 
report which combines the results of a number of studies is this:- Were 
the subjects initially comparable across stud'ies, or were the studies 

dealing with different types of children? One approach to answering 

if 

this question was contained in the body of the report, hamely a 
comparison of the project children on several initial. measures 
'(SES, IQ, ^d mother's education). A second approach is to analyze 
the actual criter-'a and procedures used for sample selection and 
assignment to program and control groups. Since the projects included 
in this analysis were conducted independently (with the exception 
of those projects conducted by the same principal investigator), no 
two had criteria and procedures which were exactly alike. In order 
to ^et the reader form his/her own opinion on the comparability across 
projects, the selection processes of the projects will be summarized 
in three sections: 

- source of subjects 

- selection criteria 

- procedures for assignment to program or control groups. 

Source of Subjects ^ 

As seen in Table B-1, most projects recruited their subjects from 
the. general community (Usually a fairly well defined neighborhood). Two 
projects (Gordon and Palmer) recruiced their subjects from names on 
hospital birth records. The Woolman project included children referred 
to his program by the school district. 
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^f. , Selection Criteria 

As shonn In Table B-.2, a variety of criteria were u^ed In selecting 
^ the saiqiles* All projects used geographic and age criteria, and all 
but Woolnan's specified some type of SES criteria. Table B-3 ^ 

I, delineates the specific SES criti^ria used. One should note that 
the Palmer project was the only one to make a specific atten^Jt to in- 
clude middle class children as part of its saiiq>le. Many projects 
specified some sort of health crlter^.a, usually designed to eliminate 
Children with orgc *c impairments. Several projects did have special 
selection criteria which caused their samples to difter from the others 
in Important ways: ..-^-^^ 

- The Palmer project selected only bbys. 

- The Karnes project selected only children with an IQ of 70 or 
above (this oroiect has the hi^^hest mean pretest IQ). 

v» - The Perry Preschool and Curriculum Demonstration projects 
selected only children with an IQ below 85. (These two 
projects have the lowest mean pretest IQ's,) 

- Finally, the three New York projects specified that the children 
must be English speaking (Levensteln relaxed this criterion 
for later waves), although most projects in other areas would 

not have found this criterion relevant. Only the Woolman project 
had a large proportion of Spanish speaking children. 

^ . 

Procedures for Assignment to Program and Control Groups 

The procedure used to create the program and control groups is one 
of the most crucial factors affecting the validity of research findings 
on program effectlveriess. If propel procedures were not employed 
there is no real way to know whether the program and control groups 
were comparable to begin with, and, hence, there is no way to accurately 
measure whether the program had any effect. 

A major concern in sample assignment is the question of self- 
selection. Bernstein et«al. state: 
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Obviously, if clients themselves determine whether or 
not to seek treatment, one never knows whether it is 
the treatmen^^ itself which is responsible for observed 
differences beftween the experimental and control groups, 
. or whether other variables correlated with the selection 
of treatment versys control are responsible for the 
observed effects. (Bernstein et. al., p. 109) (1) 

Thus, if a study were designed in such a way that the program children 
were those whose parents volunteered for- the program, while the control 
group- consisted of children whose parents may have decided not to 
volunteer for the program, the two groups were initially different in 
an important way. The post-treatment differences between experimental 
and control groups might be due, not to the program, but rather to the 
fact that the program children had parents of the type which would 
volunteer for such a program while the control children did not. 

The more generic problem is that, if the assignment proceeds does 
not closely approximate a randomized assignment to program and control, 
the results may be biased to an unknown extent. A reviewer who believes 
that the program was a "good" one would be able to formulate excellent 
theoretical reasons why the control group was originally "better off" 
than the program group with the result that the effect of the program 
was underestimated. 

On the other hand, a reviewer who believes that the program was 
"ineffective" could undoubtedly also create excellent theoretical 
reasons why the control group was originally "worse off" than the 
program group and that, hence, the effect of the program was over- 
estimated. Thus, unless the program and control groups are randomly 
selected from a population which volunteered for the program (a design 
which is questionable on human relations grounds - unless other services 
are offered - and which is nearly impossible to implement in our 
society), doubts can always be raised as to thv. initial comparability 
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of the two groups^. These doubts can be raised even in nunarous in- 

- dicators of initial status (e.g., I.Q., SES) were collected at the 

tern''- ' ' ' ^ 

outset indicate that the, two groups vere comparable, since it ican 
always be hypothesized that the "true difference' was not reflected 
in these measures. 

In general*, the projects used in this analysis come closer to 
being experimentally valid. After reviewing their sample selection 
and assignment procedures, we divided those projects included in the 
analysis of special education and retention into two groups: those most 
closely approximating a randomized experiment (Gordon, Gray, Weikart, 
and Palmer) and those whicn were xsto^ •*::uasi-experim€^tal" (Levenstein, 
Miller, and ZiglerX.^ ^Another reviewer could have arrived at a different 
classification since the differences are not always clear-cut. Therefore 
the procedures for assignment to program and control groups will be 
breifly described for each project so that the reader may make an 
independent evaluation of their validity. 

Kuno Seller's Philadelphia Project 

Each of the four scliools opened a nursery 
program for fifteen four-year-old children. 
Applicants were recruited through notes to 
parents of all pupils* attending each of the 
four s^chools which announced the opening of 
such a program ... 

Fifty-six of the original children graduated 
to kindergarten in the same four public 
schools in which they had attended nursery 
school. Group II consisted of fifty-three » 
five year olds who entered the eatoe kinder- 
garten classes as the child^'^^n of Group I 
however, without prior ntirsery experience. 
These children were selected from a larger 
group to approximate age, sex distribution, 
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and ethnic beckgr;ound of ttie children in / 
Group I. The majority of children. in Group 
I and II graduated from. kindergarten to /first ^ 
V grade classrooms in the four' same schools in 
which the original program started. All 
children jfrom. Group I and II were assigned to 
first-grade classrooms in each of the four 
schools in such a way that an equal ptoportion 
of children frcm Groups I and II would have 
the same teachers. This was done to reduce 
differential^ effect of the educational 
experiences due to differences^between' class- 
rooms, and teachers. Frbm ther- first grade 
classrooms in tAich f itty-elght children of 
Group i tod II were enrolled^ a third group of ^ 
children was selected vho had.no prior preschool 
experience* Again these children were^ selected to 
be compairable to the age» sex distribution* and 
ethnic background of children in Groups I and II. 

i 

Martin and Cynthia Deutsch^s Institute for Developmental Studies Program 

As the program became established, an incieasing 
nuiaber of parents volunteered their children for it. 
However, particularly in the early stages of the 
program's operation, It was also necessary to conduct 
active recruiting in the community. Staff members 
obtained the names of children from a variety of 
sources: from church groups, from response to posters, 
from word-of-mouth information,^ from. other children, 
from teachers and principals, etc.^^Mmimal demands 
were then made on the parent(s), who were asked to 
respond to a short interview given in their home and to 
bring their child to the school for a short observational 
period . 

A final sample was chosen from the group that 
had been gathered through these recruitment proc- 
^edures. 

Approximately one third of the children selected 
by the above criteria could not be handled by the 
small number of Institute classrooms, and these 
children, chosen randomly from the total N,, con- 
stituted a control group. Since this group was 
equivalent to the experimental group in parental 
motivation and desire for the child to be part of 
an enrichment program, it was designated the 
control group for the factor of self selection, and is 
is referned tO'Subsequently In this report as the 
Css group. The experimental group was given 
enriched schooling from prekindergarten through 
the third grade, while the Css group first en- 
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countered formal schooliag in the regular 
kindergartens (or, in son^ cases, first grades) 

^'of the ITew York City public school system. 

^(Although, most Css childrea began school at 
kindergarten, this was not stipulated as a 
requirement when the group^ v^as originally formed.) 

In order to provide further controls for the IDS 
program, two additional control groups were 
constituted, one at the beginning^^of each of the 
next two successive years. The first was the 
"kindergarten control" or Ck group. This was 
composed of children who had no prekindergarten 
training and who entered the kindergartens of 
the .same public schools that the E and Css groups 
^attended. When the Ck group was selected, of 
course, the E and Css groups were also entering • * 
kindergarten. Apart from the time of their 
selection, the children in this group differed 
from those in the Css group primarily in that they 
were not recruited nor had they volunteered for 
the Institute's program. The second additional 
control group was constituted at the beginning of 
the following school year, and included children 
who entered the same public schools as the other 
groups at the first grade level. They had no 
prekindergarten and no kindergarten experience. 

In the later years of the program, Head Start 
was in full swing, and, to obtain a sufficient 
number of children for the Ck group, it was 
\ necessary to include children who had been in the 

Head Start. program. Their inclusion, of course, 
would have the effect of minimizing E vs. Ck 
differences, and thus was an experimentally 
conservative choice. 

Gordon's Parent Education/Backyard Learning Center Proj^ect 

The^ procedures used by the Gordon project to assign children 

to program or control groups were quite complex and will orly be 

summarizea uere. Three waves o'f children entered the project. 

For the first wave: 

Assignment to experimental or control groups was 
based on randomization of geographic area to 
avoid contamination. Towns and their surrounding 
areas were randomly assigned as experimental or 
control toi^is then they were randomly assigned 
as Negro or Caucasian towns. A given town 
became experimental for one race and control f " 
the other. Gainesville, which has a relatively 
large population, contains control and experimental 
subjects of the same race but in^differeuc 
areas . • . (2) ^ 
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Mothers of children In program areas were Invited to ••participate 
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Half the control pbpulatlon (C^) were also contacted 
and Invited to participate In a program for helping 
the University learn how babies grow. They were 
Informed that they would be visited about once a 
month and that some testing of the baby*s develop- 
ment would be made periodically. The remainder 
of the control population (C2) was not ^solicited 
for active participation untfll the baby reached* his 
12th month birthday, at which time a parent educator 
visited the family and invited the mother to bring 
the baby in for testing. (3) 

For the second wave : 

. ♦ . three new groups, (£2* C^, and C^) selected in 
fashion as the original population . . • , and randomly 
assigned to series stimulation, "other" stimuation 
both considered experimentead for the current 
analysis and a new control group, were started in 
July 1967 ♦ They were drawn from all the eligible 
babies bom in the hospi^^al between May 1, 1967 and 
October 31, 1967* (4) ^^^^ . 

At the start of both the second and third years of the project, 

children from these two waves were randomly reassigned to experimental 

or control status for that year. At the,^art of the third year of 

the project, a new wave of children were added who ^re of the same 

age as thfe original children (i.e., now two years old). (5) 



This wave was randomly assigned' to experimental or control status 
for the final year of the project. Thus, all parents volunteered 
for a program to study young children and all children had the 
possibility of being assigned to experimental or control status 

for at least one year of the project. 

\ 

V 

Susan Cray's Early Training Project 

Sixty-one low-income children were randomly assigned into three 
groups: two groups'^ which received the program (beginning at different 
ages) and one control group. The two progran groups ai;e treated 
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Jolnily In this analysis. Since program and control groups were 
randcmly assigned from the same population (a group of children 
whose parents volunteered for the program) > there Is no self- ^ 
-selection factor contaminating a comparison of program ^nd control 
groups (both volunteered with the possl]blllty of reclevlng the 
program)*. A second control group was established In another city (6) 
This group Is Included In mosf of analyses In this report, but 
Is excluded from the analysis of special education and retention 
because of the self-selection factor (since this group was recrult^ed 
specifically as a control group) and becat^e this group ^as In a 
different school system (which would contaminate the results on 
special education and grade failure because of differences ln**school 
policy) . 

Susan Gray's Family Oriented Home Visitor Program 

The children were randomly assigned to one of three groups: 
Extensive Home Visiting (EHV) , Materials Only Home Visiting (MOHV) 
and Control. There were three waves of children In the project. 

Merle Karnes' Research an5 Development Program on Preschool (^lldren 

Two waves of children entered the Xarnes project. The first 
wave was assigned to one of three curricula: GOAL, Berelter- 
Engelmann, or traditional-. The second wave was assigned to one 
to ojie of three curricula: Berelter-Engelmann, Montessorl, or 
Community Integrated. There were no untreated controls. For each 

1 

wave the assignment procedure was as follows: 

/ 

The 1960 Stanford-Blnet Intelligence Scale was ' 
administered to eligible children who were then 
stratified on the basis of their intelligence 
quojcients iiito three groups: IQ scores 100 and 
above, 90 through 99, and 70 through 89.4. The 
children were a^signc \ to class units (N«15) in 
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which one-third of each class coiisisted of ^ 
'children who had scored in 'the "high" IQ range; 
one-third, in the "middle*' range; one-third, the 
"low" range. Mean intelligence quotients were 
then computed for' the three^ strata and for each 
class unit. These means were evaluated for 
comparability between class ugits as a whole and 
for strata, be twe«i classes, fhese strata insured 
a balance range pf intelligence scores in -^ach 
class unit and provided an opportunity to eval- 
uate the effectiveness of the various programs on 
children from different ability groups. 'Tie 
mean IQ (approximately 95) of children placed* in 
' classes is, of course, higher than the mean of 
children screened i * 

Class' units were examined to assure comparability 
of SGX and race. UTien .necessary, substitutions 
were made between classes to maintain an 
approximate ratio of 67% Negro children an^ 
33% Caucasian' children and a ratio oi approxiinate^y 
50% male and 50% female children. Finally^.* each 
class unit was randomly assigned to a particular 
intervention program. (7) 

Phyllis Levenstein's Mother-Child Home Program (8) 

The procedures used by the Levenstein project to assign children 

to program or control status were "quasi-experinfental." Three coho.rts 

of children are used in the analysis of special education and gi^ide 

failure. 



The first cohqrt consisted of children from three housing projects 
one project was randomly designated as a ^ program project, while the 
other two were control projects. The children in the control projects 
were recruited for testing only; however, one of tae latter groups 
were given the program during the second year (i.e., when the children 
were three years old), and, hence, is treated as a program group. 
The second cohort consisted entirely of program children, while the 
third contained two groups - one group recruited to receive the ] 
program arid a control group recruited to receive the program materia' « 
only (i/e., no instruction was given). An "after-only" control group 
wa^ecruited in the first grade; however, the extent to whlrch self- , 



felectlori vould make this grot*r> not comparable to the program groups 
is imknotm. It vould seem, on t|ie basis of the selection procedures 
described that the other two control groups wouJ.d be mbre likely to 
be comparable to the program groups (since thdlr parents did volunteer 
them for participation of some sort in their ^eschool years, if only j 
testing or receiving materials) . More importantly, since the group 

i 

was drawn froin a first grade population, children who were assigne'l 
to special education prior to first grade or in the earl^y stage of 
first grade would be epresented (i.e., thej sample was drawn from 

regula** first grade clas&iTooms) . Therefore, this group is not 
Included in the special education or grade failure analyses, but 
is included 'in I.Q. test analyses. 

Louise Miller ^s Experimental Variation of Head St^rt Curricula 

The program groups consisted of 21A children enrolled in Read 
Start classes in Louisville, Ky. Jlhe cont:rol groiip' consisted of thirty-- 
tour children from the saise neighborhoods - twentypone of whom were in 
thfi Head Start waiting list are unknown. The program and control 
groups were not selected from the same population; therefore, there could 
oe an initial difference due to the self-selection Ifactor (at least in 
"^the case of the thirteen children who were not on t^e waiting list) . 
The control group contained significantly more white children and 
significantly -^v^re children* with both parents in the household. Thus, 
there is rca&un to believe that the program and control groups are not 
totally comparable. \ 

The procedtvres used to assign program children toi one of the four 
variations in cu*.rlcula were as follows: * 

15J 



The four experimental replications were placed 
1^ four "target areas" of the city, •••Thus It 
was Import/mt to assess sample characteristics ^ 
Bxid to balance classrooiu facilities across prpgrams^ 
' $lncs tlie jexperlraent was being conducted as a part 
of the regular Head, Start Program, it was also 
desirable I to provide both experimental and hon*- 
^ experimental classes In the same schools • 

The four target areas were. designated Cal- 
ifornia, Jackson, Park-DuValle and Russell^ Since 
the 4-progrnm comparison could be replicated in 
only two areas with the two Montessori 
teache'^rs, thv^ two largest ares. Park DuValle 
and Russell, were selected for this purpose^ 
All four areas contained replications of . 
the 3 program comparison t Classroom facilities^ 
in the Russell area were in general Inadequate. 
All four programs were located outjside of school 
buildings, three in churches anij^^^one in a 
small and vf^ry uld portable • /in the other 
three areas, racilitles wv^r^? in satisfactory 
school classrooms. ^ 
- * • 

To some extent the tllstrlbution or classes 
constituting the various programs into 
different geograi^ical areas insured that 
the combined p^^bgx^am samples would consist of 
similar subjects. But it was also desirable 
that children wh*" attended experimental classes 
would constitute a random sample of those who 
registered for Head Start* 



In the strict sense, "random" assignment of subjects 
would be accomplished by obtaining the names of all 
children eligible for Head Start and, assigning each 
child to one of the fourteen classes or to a control group 
by using a table of random numbers. This would not 
have been possible with a sample of approximately 
250, since it would have forced many children to 
cross the city to attend schools outside their 
Tii Ighborhoods. 
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It was possible » however, to arrange for assign- 
ment of registrants in each school on a random basis. 
411 schools contained at least two Head Start classes* 
In one school ^ both classes were experimental; however, 
in the remaining schools both experimental and 
non-experimental classes were available for 
distribution of subjects^ Registration forms were 
filled out on the same day in all schools* The 
parents' signature on the form gave permission 
fdjr children to be placed in experimental classes 
should they happen to be selected. 

When all forms were turned in, the forms were' 
divided on the basis of sex to insure a balance in 
each class. These piles were t' m shuffled and 
distributed into classes, expe' Ji.tal or non- 
experimental. (?) 



Thus, the procedures used by Miller for assignment to different 
experimental groups were quite rigorous since the comparison of 
curricula was the primary purpose of r.he project (rather than the 
comparison of program children with untreated control children). 
Francis Palmer's Harlem Training; Project (10) 

The program children were selected from the children born 
between August 1 October 31, lb/64, in the Harlem and Syndenham 
Hospitals. The controls were born in November-Decenfcer, 1964, in 
the same hospitals. The program children were recruited for the 
progran, while the controls were recruited specifically as v-^utrols. 
However, in recruiting the controls, the benefits from a total of 
four and one-half weeko of testing were stressed so that, in effect, 
the parents were volunteering for a program though of much shorter 
duration. Although the two groups were not technically drawn from 
the same population, there is little reason to suspect a 8elf--s elect ion 
bias. 
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David Welkart^s Perry Preschool Project (11) 

Five waves of children (a total of 123) volunteered for the 
program. 

The study took place in Ypsilanti, Michigan, a 
city of about 30,,000, located about 30 miles west 
of Detroit. Children came from families in the 
Perry school attendence area. This neighborhood 
was selected because the school had. a history of 
low academic achievement. Each S^iptember, the 
names of all families with 3-year-old children 
were drawn from the school census; the socio- 
economic status (SES) of these families was 
determined from the parents* education, 
occupation of the head of the household, and 
household density (rooms per person) . If the 
SES score of the family was below a specified 
level, the 3 year old was given the Stanford- 
Binet Intelligence Test. Children with low 
Blnet scores (50 to 80), bu^ no evidence of 
organic impairment, became a part of the study 
sample. Reflecting the ethnic makeup of the 
neighborhood, all the children in the sample 
were black. Thus, the study sample consisted 
of young black children of low measured IQ from 
families of low SES. 

Each year children were assigned to preschool or 
no oreschool by the following procedures: 

1; Rank the children by their Binet scores; 
make an cdd/i=vcn eort into a pre«cHnn1 
group and a no preschool group. 

2) Exchange children with simjLlar scores 
CO equate the sex ratio and average 
SES score of each group. 

3) In later waves, assign younger siblings 
to preschool if their older siblings 
attended preschool, to no preschool if 
their older siblings did not attend pre- 
school. (This was done to keep preschool 
from having an indirect effect on the 
siblings who aid not at^tend preschool.) 

4) Exchange children with similar scores when 
a child assigned to preschool cannot attend 
due to lack of transportation or a working 
mother. (No funds wore available for trans- 
portation or full-day care, and special 
arrangements could not always be made.) 
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David Weikart*8 Curriculum Demonstration Pro;iect 

Data Included. In this report are for the middle two waves of 
children. Children with a brother or sister already In the project 
were assigned to the same program as their siblings. The remaining 
c'alldren In each wave were divided into three equal-sized groups 
mtchcd on ethnicity, sex and age to the extent possible. Twins were 
assigned to the same groups. The three groups were then randomly 
assigned to program types. 
David Welkart's Carnegie Infant Program 



The experimental design specified that sample children 
would be randomly assigne^ tc three different treat- 
ment groups — two groups (experimental and contrast) to 
be seen by either teachers or community representatives 
and the third group (control) to receive only the same 
testing and-data collection as the other groups. In 
order to avoid the possibility of biasing the original 
sample by accepting only families who were willing to 
be assigned to a "no-treatment control group" or 
alternatively by losing families following assignment 
to a "no-treatment group," none of the three levels of 
participation was described as "no-treatment." 

After a family's eligibility had been determined, the 
teacher explained to parents that project staff were 
interested in the different ways children learn by 
playing; then she asked the parents if a staff member 
could periodically bring toys to the home to be used 
by the mother and the staff member for playing with the 
baby. This described, equally well, both the home 
teaching sessions and. the adjmlnistration of the Bayley 
Scales of Infant Development, so that regardless of 
which treatment the 'family received, the satae initial 
description was accurate. All parents were^**old that 
the project would last sixteen tnonthn, that the mother 
nurt be present at each oesaicn wAth tlie child, that 
no session wou^d be held without her, and that she could 
choose the times for the appoint ^ents. 

After a sufficient number of families had agreed to 
participate, members of the research staff assigned 
them to treatment groups according to a table of random 
numbers. During this random assignment the research 
staff did not know which names belonged with each 
treatment group, since they were numerically assigned 
Four sets of two children each were assigned jointly; 
two sets because the children were twins and two sets 
because the mothers were sisters. 
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5^^ ; ,. ' • ' Plnally^ all f^amllles assigned, to the experimental 

llllS treatments (e^eriaental and contrast groups) were 

again approached and asked If they would allow a 
staff member to bring toys on a weekly lias Is for use 
by the mother and staff member together for playing 
, . . with the baby. Only one family could not comply 
with this request and had to be dropped from the 
sample. Farsilles assigned to the control group 
(those receiving testing and data collection only) 
were not approached with this request. However » since 
they were neve told that the regular vlslf.s to their 
homes by research staff did not constitute treatment, 
control group families felt that they were participating 
In an Infant education program. " \ #^ 

The contrast group Is not Included In the cutrent paper. A 

fourth group, consisting of children In the original sample who 

did not become part of any of the three groups but v were recontacted ^ 

In first grade. Is Included in some analyses. / 

Myron Wdolman^s Micro-Social Learning System 

The Woolman project consisted of one experimental group and three / 
control groups. The experimental group was selected by the Vlneland 
school district. The group consisted primarily of the children of 

/ 

/ 

migrant families, the majority of whom were on welfare. About 10% 
of the children were of higher socioeconomic status (These wero children 
whose parents had requested ^hat they be allowed to enter the project). 

The "Initial control" group was selected by the state of New Jersey 
and consisted of children who had had other preschool experience. Sample 
data Indicates that the control children scored significantly higher on 
j . pretest IQ. However, pending a more complete description by the state 
I of the exact selection procedure, this group has been excluded from analysis. 

The "parallel control" group consists of a random sample of children 
j currently (In 1977) In the same classroom.as the experimental children. 

/ This group was considered Inappropriate for the special education-grade 

/ failure analysis. (Obviously, there would be no difference In those in 

special education classes since children were selected from the same 
classes. Similarly, the question of grade failure would be confounded 
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since the children selected from the classrooms of those who had 
failed would consist primarily of children wno had entered school In 
a different year). The group Is, hpwever, used In the IQ score 
analysis. 

The third control group, known as the %aseline controls," 
consists of a random sample of the general school district population 

o 

which entered the school In the yeax preceding the experimental. group. 
This group was the one selected for the special education and grade 
failure analysis and is further described In that section. 
Edward Zlgler^s New Haven Follow Through Study 

Two waves of children were u^d In the study. In the first wave 
the program groups consisted of children recruited for Follow Through 
in several low~ Income areas In New Haven. The control group 
consisted of -''all of the economically disadvantaged children in one 
classtc^om from each of three schools located in similar low-income areas." 
For the second wave of children, the control group consisted of children 
drawn randomly from the same schools from which the controls for the 
first wave had been drawn* Since the program anS control children 
were not drawn from a common pool of children whose parents had volunteered 
them for Follow Through, the extent of the self-selection bias is unknown. 
It is likely to be minimized by the fact that the controls were drawn 
from different schools than the program children (meaning that the 
controls did not consist of children whose parents had decided not to 
participate in the program) . (12) 
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Primary Source of Subjects by Project 
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Project 

Beller 

Deutsch 

Gordon 

Gray-ETP 

Gray-FOHV 

Karnes 

Levenstein 

Miller 
Miller 
Palmer 

Weikart-Perry 
Weikart-CD ^ 
Weikart-Carnegie 
Woclman 



S oulrce 

general community 

general community 

hospital records 

general community 

general community 

general community 

gersral community and public 
housing projects 

Head Start lists* 

Head Start lists* 

hospital records 

school district census 

school district census 

school district census 

general community and school 
refer als 



Zigler 



general community 



* Part of the control group was drawn from the general community rather 
than from Head Start lists^ 



Location 



A&e 



Table B-2; Saaple Selection CriterU Used by Projects 

SES Sex I.Q. Languajge Race Phvcicsl or Ment^tl Health 



Beller 



PhUsdelphia 



Set B-3 



no serious tttntaX or physical 



Deutsch 



Gordon 



Harlem 



4,5,6,7,8 



See B-3 



English 



Black 



Northern Florida 



0,1,2 



See B-3 



generally godd physical condition » no aeriou^ 



8ingle*hirth» no breach or Caesarian delivery » no 
cotBplicationa* no evidence of aental retarda tion • 
^ • sother 
illnssf 



Gray ETP 



Gray ?OHV 



Hurfreesborc or 
ColuMbiA> Tenn> 



4,5 



See 6-3 



Black 



Nashville, Tenn. 



0,1 



See B-3 



Ksmes 



Chaapsign ^Urbana, 
Illinois 



Sec B-3 



70 or above* 



Levenstein 



Long Island 



2,3 



See B-3 



early vaves were 
English only 



Miller 



Louisville 



See B-3 



PslsKr 



Harlem 



2,3 



See B-a 



male 



English 



Black 



5 lbs. or more birt!\weig^t» no mothers with histor 
of narcotics a^ldiction or svphillis^ go twins 



Weikart-Perry 



Velkart-CD 



Perry School Dist., 
Ypsilanti> Mich> 



3,4 



See B-3 



less than 85 



Black 



no "organic irivolvement" in retardation 



Ypsilanti, Mich. 



See B-3 



less than bJ 



Black 



no "organic Involvement" in retardation 



Veiknrt-Camegie 



Ypsilanti, Mich. 



0,1 



See B-3 



Woo loan 



Vineland, N.J. 



4,5 



' See B-3 



Zigler 



New Haven 



See B-3 



* For longitudinal groups (one pre-post group not incli»'*M in the current follow-up was cjnpofied of retarded youngsters). 




Table 



SES Selection Criteria 
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Income 


Education 


Occupation 


SES 


Housing 


Beller 






mother working 






DeutPch 








.low by institute* 
scale 




Gordon 


"indigent" . 
(1st group 
OEO criteria 
(2nd) 








f 


Gray ETP 


. — -| 

below poverty 
level 


ninth grade or 
below 


skilled or \ 
unskilled 




poor housing 


Gray FOHV 






unskilled, semi-" 
SKXXxeu f wcxxaire , 
also mother not 
working or full-tiriie 




project, subsidised, 
or deteriorating 


Karnes 




educationally 
deprived 




economically 
deprived 


i 


Levenstein 




high school or 
less 


skilled or less 


* 


1 

eligible for public 
housing 


Miller 


Head Start cr 


iteria 








Palmer - 

> 








1 td X J. X W C 1p ^ X c* o o , 

half middle on the 
Hollingshead ISP^ 




Weikart-Perry 








Cultural depriv- 
ation below eleven 




Weikart-CD 




i 




ti 




Weikart- 
Carnegie 


• 


• 




' ti 




Ziglei ^ 
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h school or 
less 


semiskilled, 
unskilled, 
unemployed 


1 


1 nu income housinK 

1 



• APPEHDIX B-2 

« 

FOLLOw-UP DATA COLLECTION AND DATA ANALYSIS kETHODS 

I - / 
t 

i. 

An werview of the methodology for the collection and analysis of 
the follow-up data was described in the body of this report under Part 
II, Data Collection Methodology. Technical detail on the design of 
the Instruments,, data^collection and coordination methods (including 
interviewer characteristics), and data analysis methods (including 
response rate data) are discussed in this appendix. Copies of the 
instruments and instruction? are found in Appendix 
I, Parent and Youth Interviews 

A* Data Collection Methods 

After pretesting in the summer of 1976, the final drafts of the 

c 

Parent and You^h, Interviews were circulated to Consortium members for 
conanents the first week in September. A training session for the 
Interview field Supervisors was held in Philadelphia on September 17. 
The supervisors from seven project sites attended and discussed 
shared concerns.* After incorporating the suggestions of various 
sites, the final Parent and Youth Interviews were printed and distributed 
the beginning of October. Video-taped training sessicijs were prepared 
at Cornell and distributed to all sites for their continuing use in 
training interviewers as they were hired. Interview Instructions 
and other training aids such as ^'Ethics of Interviewing" were sent 
with the interview materials. ^ 

The Consortium members met during the Northeastern Educational 
Research Association Meeting (NERA) at the end of October to discuss 
any problems with the Interviews as well as to make decisions on the 

'» 

The site supervisors were experienced professionals or graduate students 
and were of various ethnic groups. 



data to be collected on achievement tests and school records. The 

Interview Instructions were then up-dated throughout the fall^^as 

recording ambiguities were found. No changes, however, werp made in 

•ft ^ 

the wording of the actual questions. Interviewers at each site 
brought their problems to uhe site supervisor who ^iien^ommunica**ed 
frequently with Cornell staff by telephone md iettet. • Clarification 
for Interview Instructions and status reporti> on data collection 
were sent to Consortium luembers regularly and tlie final revised Int^**view 
Instructions were distributed in early .January 

The • interviewing, which had begun in O^tdber, 1976, for some 
sites, was completed by most sites before Jlily 1, 1977. Two sites 
which were delayed for a variety of reasons* will complete their 
interviewing aqd test^ing this fall. 

1. Informed Consent 

Either consent/permission forms were signed at the time of the 
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i'arent interview, or an aucnurx^tiLxuii wao ^xgneu cxnu octtu %.».»»,^^^»» ^..^ 

mail before the interview, or a verbal* request was followed by a 

letter. (All projects except Woolman obtained written consent before 

testing or intervievjing childi:en. However, permission for testing 
" ^» > 

was obtained from all schools.) Only twenty-two parents refused to 

>- ^' 
participate. 

2. Payments to Respondents 

The amount of money paid to respondents was an individual project 
site decision. All sites except one allocated money for respondents. 
Typically, the sites allocated $10^.for the interviewing. One project 
paid the youth the $10, and did not pay the parent. Two sites paid 
the parent $10, and did not pay the youngster. Two projects paid the 
parent and the youngster $5 each, fnd one project paid th^ parent $6 



rnd the youth $A, Two sites allocated less money — one paiu the 
parent $3, ^^d the ether site paid the parent $5 and did not ^ay 
the youngster. One project paid an additional $5 to the parent 
'(above teh $10 interview payment) for the WISC administration. 
3 . Characteristics of the Interviewer3* 

The ten project sites for which we have received this information 
employed ^a total of fifty interviewers. The Parent Interviews were 
conducted primarily by female interviewers (80.7%); male interviewers 
conducted ^rhe remainin';' 19.3%. A total of 75.6% of the Parent 
Interviews were done by white interviewers, 2 3.2% were conducted 
by Black interviewers, and 1.2% by Cuban or Puerto Rican interviewers. 

A total of 51.2% of the youths were interviewed by male intern- 
viewers and 48.8% were interviewed by female interviewers. White 
interviewers conducted 65.6% of the Youth Interviews and BjLack inter^ 
viewers interviewed 34.4% of thfe youths. Six projects reported 
data on the educational background characteristics for thier thirt; wo 
inten/:i2^^er^. A total of 34.4% o' the interviewers had a BS degree or 
were : -sently undergraduate students i 53.1% had a Masters Degree 
(usually in Education or Psychology) or were currently graduate students 
3.1% were frum the community withodt advanced degrees but were previous 
project staff members; and 9.3% were from the community who were hired 
for this follow-up study (e.g., r former high school basketball star). 
A to*-.al of one-third of the interviewers were staff members previous 
to *'\L^ tol low-up Study. 

* Data fri>m tea sit 
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4 • Characteristi c . f the Interview 

a) JPJLace of the Inte^iew: Most of the Parent Interviews 

^ tooif place in the pa^'ents' homes (65.7%); some parents were interviewed 

/' 

in the project c-»iter (9.5%); a few were interviev^ed by phone (.3%)^/ 
and the remainder were interviewed in other placed &%* \ as a collece 
or Board of Education, and occasionally at mother's place of work^' 
(24.5%). / 

b) Interest of Parent in Interview: The interviewers ratyCd 
71.3% of the parents as highly or strongly i'nvolved and interested 

in the interview; 24.6% of the parents were raied as neutral; and 4.1% 
were rated as not involved or intere^tea at all. 

c) Length of Interviews: The Farent Interview typically 

lasted about thirty minutes* The range was from ten to ninety minutes. 
The Youth Interview typically lasted fifteen to twenty minutes, with 
a range of five to ninety mluutes* 

i 

B- D ata Analysis Methodology j 

1. Office Coding Methods and Reliability 

Thirteen Office Codes fo^ the open-ended questions on the 
interviews were developed at Cornell after about 350 interviews were 
received from the field. The Hollingsh(Bad Occupational Scale (.±957) was 
used zo code the occupations of household members, the job aspirations 
expressed by the youth, and the parents' ^oh aspirations for the young 
person. The occupation of household meinbeVs was coded in the field by 
suiiervisors and carefully monitored for consistency at Cornell. When the 
first five interviews were received from each £?ite. the Hollingshead cjdes 

\ 
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were recorded at Cornell and any discrepancies were discussed by phone 
or letter with the site supervisor. This process was repeated until the 
necessary reliability was achieved for each site. After that point, 
the occupation codes were checked for consistency when the other office 
code reliability procedures were done* The major share of the office 
coding was done at Cornell in the spring by five coders and a coding 
supervlaor. In July, a 5% random sample of all Parent and Youth 
Interviews was done by two independent coders. The coding reliability 
was computed for the total of thirteen codes using the percentage of 
agreement method. The rr.sulting figures were 96% agreement on the 
total of 2,687 i'teras for the thirty-nine Parent and forty-three Youth 
Interviews sampled. For the individual office codes, the exact agree-- 
ment ranged from 90 to 100% on every Office Code* V?hen the percentage 
* of ^agreement was adjusted * far agr«eme«t%witbi^ a ^ate^ry^ ( tojr. ex^yle^. , 
cognitive aspects of the program), the percentage of agreement for the 
thirteen Cffice Codes rose to a range of 95 to 100%. 

In order to minimize keypunching problems and later data cleaning 

/it 

problems, careful editing of every interview was done before sending 
it to the keypuncher. Each interview was checked for correct skip 
patterns^ valid codes, legibility of entries, deletion of names, and 
empty boxes. 

Response rate computation for Interviews is discussed below in 
Section V. 

II. V/echsler Intelligence Scale 

The Wechsler scores (WISC, WISC-R and WAIS) were sent to Cornell 
in a conanon format on coding sheets. A total of 723 Wechsler score ^ veie 
received from seven project sites in time to be used in this report. An 
additional fifty-six scores for the WAIS will be* analyzed for the sites 
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that will be administering Wechslers over the summer* The Zigler project 

sent 185 PPVT scores* 

Six project sites provided inforiration on WISC tester characteristics. 

They hired twenty WISC testers; some ware also interviewers, but others 

were hired especially Lo administer the Wechslers. Ninety percent of 
the testers were graduate students or people with advanced degrees in 

psychology or education. Response rate computations are discussed 

below in Section V. 

Ill . School Record Form (Face Sheet and Supplement) 

For the October NERA meeting. Cornel'* ""taff developed an instrument 
for collecting school characteristics and student performance (marks, 
attendance, discipline)* After Consortium members expressed concern 
about the time and vx>ne^' involved in collecting this data for every 
grade, *tlfe decision was made to^deveioj a ^^hort ^form to be used by 
all sites and an optio.ial long form. The Jchool Record Form (Face 
Sheet, short form) provided data on the mo'^t critical variables: current 
status in school, placement in special education, retention, or skipped 
experience. In addition, school identification by code number, location 
and type were collected so that school variables such as funding level, 
staffing and ethnicity, for ex^ample, could be investigated through 
secondary sources at a later date. Each site agreed to p*.ovide s hool and 
achievement test data on four years (the latest available year and three 
other specified years) rather than every year'. 

The School Record Supplement (optionaJ long foirm) was designed to 
provide data on attendance; marks in r^^.ading, science and math; curriculum 
assignment (regular, college prep, voc-tec ); psychological evaluation; 
disciplinary citations; and total number of schools attended. 
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The School Record (Face Sheet) was mailed to the sites in January 
along with the achievement test forms and Instructions. The School 
Record Supplement was nailed with instructions in February, 

As of August 15, data for 1,529 School Records (Face Sheets) had 

been received at Cornell • Three project sites obtained the Supplement 
data for a total of 219 subjects • Additional Supplement data will be 

available on a sample of subje^^ts from a fourth site later this summer. 

Record r characteristics and reliability will be discussed below 

in Section IV. 

iV. Achievement Test Scores 

Because of the lack of funds, it was not possible for Consortium 
field staff to administer individual achievement tests. The decision 
was made t^ jplxCain the achievement *ores, from tests administered by 

t 

each school system. The Consortium members, after permission was 
granted by parents and schools, sent field staff to the local schools 
to record the data from the students' school Ziles. However, the 
hundi ids of schools attended by the students over many years administered 
a wide variety of tests, with a large variety of test batteries, form 
and norms, and with scores reported by a variety of ir^thods (raw scores, 
percentiles, stanines, grade/age equivalents, and standard score^"^ . A 
universal form was designed by Cornell ?;taff and sent to project nltes 
with preliminary inscructions in January. As of August 15, one or more 
Achievement Test scores f6r 1,305 subjects had been received at Cornell. 
1 . Characteristics oi School Record and Achlevc mea t T est Reco rders 
Six project sites (Beller, Deutsch, Gray, Levensteiu, MiUer, 
Karnes) provided data on who recorded the data from the school files 
The Interviewers on most field staffs also recorded the dat i from the 



school files. ^They were pradominately undergraduate or graduate students 
or had college degrees. One project (Levenstein) , however, arranged 
for classroom teachers to record the school record data on forms provided 
by the Levenstein project. 

2. Reliability of Coding the School Record and Achievement Test Scores 
For two project sites (Woolman and Gray) a photocopy of each of 
the student's actual school records were sent to Cornell to be transcribed 
independently by coders at Cornell. For the Woolman site, seventy-one 
achievement test records were transcribed at Cornell from the original 
.3chool records to compare with the recording done by field recorders. Using 
the percentage of agreement method, the resulting agreement between Coder 
I (in the field) and Coder II (at Cornell) was 98%. The highest category 
.^*"ii4iiiagrQe»«tt* was on the recording of battery or level of test administered. 
For the Gray site, a random sample of seven complete school lolders (10%) 
were sent to Cornell. The agreement was again high between Coder I and 
Coder II. The percer)tage of agreement was 94% for the School Record (Face 
Sheet), 93% for the Supplement'' and 98% for the achievement tests, when 
adjusted for the discrepancies between Information not contained In 
the student file but available to field workers who could obtain additional 
information from the school syster. Although It was not possible to check 
the rei'.lablllty of the other field recorders, It can be reasonably 
assuaed t-hat the agreement would be similar given the sama high standards 
shov \ by the project sites in the ot^^er data collection processes. 
Efforts were made to keep the recorders blind as to the treatment vs. 
control group status of the subjects. 
> 
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NOTE ON RAW DATA FORMS: 

All data reporting and Interview forms were printed on self- 
carbon mltisets, so that all origiral recordings produced two 
copies. One of these was sent to Cornell, the other retained by 
the investigator, thus eliminating the need for transcription and 
chance of error In transmitting the raw data. 
^ • Com putation of Response Rates 

In order to calculate response rates for the follow-up sample, 
an attrition-disposition work sheet was sent to each project site 
'sew ^i;pendix B--6)^ Six sites (Gray, Karnes, Levenstein, Miller, 
v%.i*<art and Uoolman) sent the data to Cornell in time to be inc uded in 
this report, the final disposition of each ID case number in the six 
sites was assigned to one of the following categories, 

(C) Completed « Code 1 

(R) , Refused to give permission, refused to b.e interviewed = Code 6 
(U) Located but unable to test because 
Moved « Code A 

Unable to test, keep appt,, etc, « Code 5 
Terminated, unable to complete test Ccie 7 
(L) Lost, unable to trace on records * Code 3 

(A) Attempted to locate and test: (U) -f (L) = Codes 3 + 4 + 5 + 7 

(OS) Out of sample 

Wave not scheduled to test at this follow-up =» Code 2 
Dropped from sample at previous follow--up Code 8 
No Data, unknown disposition = Code 9 
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Response rates are defined as the number Of f tnal dispositions in 
a given category divided by the number of cases in the total sample 
or subsample. The three response rates computed for completion and 
refusal categories are shown below: 

Response Ratej^ : Disposition divided by total possible cases 

C 



e.g. CR^ = 



C + R + A + OS 



Response Rate^ 



Disposition divided by attempts (excludes out of samples) 



e.g. CR. 



C + R + A 



Response Rate^ 



Disposition divided by actual cases cor acted 
(excludes lost) 

e.g. CR, « C 



C + R + U 



The Response Rate Computations and Final Dispositions by Instrument 
for the six project sites are shown in fable B-A. 
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Table Response Rate Computations and Final Dtsposltions for Six Sites 



Disposition 



<1) Coinpletions 

(2) Cor.iplcti6ns 

(3) Completions 

(4) Refusals 
%5) R^*fusals 

(6) Refusals 

(7) Attc.ripts 



(8) Kot Attcnpted 
(Out of Sample) 




Rate Equation 



0? 



C + R -h A 



CR. = 



C h R l U 

R 

C + R -h A h OS 



• * ■ 



K _ 

C R -h A 



Parent 
Interview 
N 



3 



R 



C 4 R + U 

AH = _A ± (;.±j^ 

C h R -H A h OS 





C -f- K -I- A ■»■ OS 



590 



590 



590 



22 



22 



22 



793 



600 



42.4 



74.4 



82.3 



1.6 



2.8 



3.1 



57.0 



43.0 



Youth School 
Interview^ . Record 



600 



600 



600 



18 



18 



1« 



769 



624 



% 

43.1 

78.0 
86.7 
1.3 



2.6 



55.2 



44.8 



N 
1072 

1072 
1072 
16 



16 



.1227 



166 



% 

77.0 

87.4 
93.1 
1.1 



1.3 



1.4 



88.3 



Ach't 

Test 

N 

860 



860 



860 



17 



3 7 



37 



1026 



11.9 367 



% 

61.7 

83.8 
91.0 
1.2 
1.7 

1.8 
73.7 
26.3 



Wise 
n' 

606 

606 
606 
18 



43.5 



78.2 



80.9 
1.3 



18 



775 



618 



2.4 



55.6 



4 -.4 



Total includes J 3 Parent Interviews and )6 Youth Interviews received late and not 
included in other data analyses for this report. 
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As shown in Table out of the 1393 original subjects in the six 

sites, 590 Parent Interviews wer§ completed, resulting in a completion 
.rate (1) of 42. 4%; The rate of completion (2) based on the number of 
parents located and attempted to test is 74.4%. The completion rate 
(3) based on the parents actually contacted for this follow-up is 82.3^. 
The refusal rate (6) for the parents actually contacted is 3.1%, The 
refusal rate (5) based on the total number of parents attempted to 
locate -is 2.8Z. The refusal rate (4) based on all possible parents In 
the original sample is 1.6%, The total' number of parent Interviews at- 
tempted divided by the total number in the original population (7) 
yield.9 a result of 57.0%. This result may be considered a sampling 
fraction or a measure of the effort to locate the parents which was 
dependent on time, money, Iwck, etc. In contrast, -the sample not 
attempted (8) or out of sample remainder is 43.0%. As discussed in* - ^ 
more detail in he technical supplement on attrition, the final samples^ 
are generally representative of the original samples in terms of dif- 
ferential rates of program and controls found, pretest Stanf ord-Binet 
IQ scores', Hollingshead ISP and mother's education. 

The results are similar for the Youth Interview except that the 
refusal rate is lower. The refusal figure of eighteen for the YoutK Interview 
^includes both youths who refused and parents who refused to have their 
child interviewed. 

The refusal rates for the Youth Interview are 1.3% based on total- 
original sample (6); 2.3% based on number located and attempted to test 
(7); and 2.6% based on subjects actually contacted (8) . The comr ^etlon 
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rates for the Youth Interviews are: 43-1% based on total subjects 
in original sample (1); 78.0% based on located subjects (2); and 
86.7%. based on number of subjects actually contacted for this follow- 
up (3)- the percentage attempted is '55.2% and the out of sample 
percentage is 44, 8%, 

' The Wechsler IQ response rates are similar to the Youth Interview 
figures. The School Record and Achievement have a much higher 
completion and attempted rate primarily because the Woolman site 
had access to all school records and the Weikart site sent data on all 
school records as of fourth grade. 

In summary, the refusal percentages of 2^3% are acceptably low 
^aud ^hg completion pQrcentag« appear sati^f^<feoi»y *ivt^i\ th'e •financial 
and time constraints. 
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APPENDIX 'B-3 ' 
ATTRITION 

it 

One of the most serious threats to any longitudinal study is the 

problem of attrition — th^ fact that, over time, some of the sub j tuts 

drop out of a study (due to moving, death or a myriad of other reasons), 

"Differential mortality' effects s^em from differential 
subject and program losses from social experiments. If the 
loss of observational unr:s is different for the 
treatment and control groups, and the differences 
cannot be attributed to chahce, then external validity 
is threatened," [Bernstein et al., p. 131] 

The analysis of whether attrition has caused biases in the final 
Siimple will be directed towards answering three specific questions: 
1) Were there different rates of attrition for program and 
control groups? 

^ *25 Were the ^finajTsamples** different on some important characteristic 
from those who dropped cut? 
3) Were there any instances of differential attrition (i.e. do 
significant differences on the characteristics emerge when 
the sample is divided into four groups: program final sample, 
program dropouts, control final sample, and control dropouts)? 
^or purposes of this report, attrition is defined as the failure 
.to report information for a particular child on a particular instrument. 
This d(>finitLon is applied because the differexit methods for collecting 
inforrAatlon occasionally resulted in considerable divergence among the 
samples receiving different instruments. For example, collection of 
Youth Interview md WISC-R data required actual contact with the child, 
while collection of the School Becord Form data required, instead, 
actual contact with the child's school records — a frat which could 
be either more or less difficult than actual contact vith the child, 
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depending on the cooperation ar.d organization of the school district. 

Attrition in the Cu rren t Follov-Up 
There are five measures of attritiofT^in the current follow-up: 

\ 

— whether r'j. Parent Interview was reported. 

— whether a Youth Interview was reported. 

— whether a School Record Form was reported. 

— whether a WISC-R was reported. 

— whether any of the above was reported (referred to hereafter as 
•'general attrition"). 

Analyses are presented for each of these five measures of attrition. 
However, the written discussion wiLl concentrate mainly on the final 
measure. - 

'^he percentages of children found (on any instrument)/ are given in 
Table B-5. Since all projects but one (Deutsch) found roughly the snmc 
percentage of control children as they did .of program children, there 
appears to be no indication of different rates of attrition between 
program and control groups. Thus, for £itl but one project the answer 
to the first question lf» negative. However, the percentage found does 
vary widely among projects. Tables B-6 through V9 present similar 
analyses for the Individual instruments* 

To answer the second and third questions, three characteristics werr 
selected: pretest Stanf ord-Binet IQ scores (or other IQ scores as noted 
in the tables), Hollingshead Index of Social Position, and mother's 
education (in grades •^rompleted) . Two by two'ANOVA's were performed 
as described in "Explanation of Attrition Tables B--10 through B-24." 
The maw effect for attrition status was used to answer the quest li^n of 
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whether the dropouts differed from the final sample, while the interaction 
between prdgram ytatus and attrition status was used to test xor dif- 
ferential attrition. 

Tables B-10 thru B-12 present the results of these analyses for ''general 
attrition/' As can be seen, there were only two instances in which a final 
sample differed significantly from the dropoutb oxi one of the three 
characteristics : 

- Heller's dropouts had a significantly lower mean IQ than his 
final sample. 

~ Palmer's dropouts had a significantly lower ISP score (i.e., higher 
socioeconomic status) t..an the final saraple (although the overall 
ANOVA was not significant). 
In no instances did the final >ample ai 'a the dropouts d'^fet 5tT rfiore than ^ 
brie of the three characteristics. 

There were three instances of differential attrition; 

- Belter's control dropouts had a lower mea*^ IQ than any of the other 
three^g'^oups , a bias which would tend to diminish the chances 

of finding significant differences favoring the program group. ' 

- Gray's control dropouts had the highest ISP score (I.e., lowest 
SES) while her program dropouts had the lowest ISP (I.e., highest 
SES)/- 

- Gray's control dropouts had the lowest mother's education. 
These two differences decrease the chances of finding significant 
differences between program and controls since the lowest SES 
controls have been lost; however, it is import xint to note that 
the control dropouts did no t have lower IQ's than the of l*v 
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groups. In' fact, they had a slightly higher mean IQ than the 

control final sample. 
Tables B-13 thru B-24 show similar analyses for the individual 
instruments. As can be seen, there are on each table anywhere from zero 
to three significants of attrition (.either main effects or interaction 
effects), although these are often from an ANOVA wMch is not significant 
overall. In evaluating the evidence of attrition, one must remember the 
definition of tatistical significance - i.e., that the probability of 
such results occurring by chance is one in twenty. If one regards the 
significance levels for' the main effect 6f attrition and for the 
interaction bet\'een attrition and program status as two independent tests 
then each table (from B-10 to B-24) contains between twelve and twenty 
independent tests of hypotheses. Looking at the information in this 
way.c-ie can estimate the number of "significant differences" one *?ould 
have^in each tab]e if all occurrtnces were chance (e,g., in a table with 
twenty tests of hypotheses,, onr would expect to find one "significant 
result'' purely by cl..»nce). 'Table B -25 presents thiw expected number of 
•'significatit results" i? there were no genuine attrition effect, plus 
;the actual i^umber of aignlfic^int results. As can be seen, the actual 
results exceed these expected on the basis of chance in seven of the 
fifteen s;ables anU are less thar those expected by chance in only one 
table. However, the fact that theie are only seven more significant 
findings than could be expected by chai^ce indicates that the overall 
effects of attritiK>n are slight. 

Two words of cautipn must be extended in intei^^reting tl.e attrition 
results. First, in some instances there were considerable numbers of 



missing values on the criterion variable (i.e,, IQ, ISP or mother's 

education). Therefore, the analyses may not always rcpiesent an accurate 

asoessment of the effects of attrition. Second, j the results of attrition 

analyses can vary depending on how one defines the original sample. 

i I 
These d^'f initions can vary due to the fact that some groups of children 

I ^ 

were not designated to be followed up an this time, hence ^ it depends 

! \ 
1 ^ \ 

upon one's purposes in doing the analysis whethe^ these groups should 
be included in the original sample. Definitions of original^ samples are 
confined in Table 

The effect of varying definitions of the original samr -5 upon the 
^utcomes of the attrition analyses can be gauged by comparing Ihe results 
of the attrition prepented on the School Record Forms in this appendix 
with the attrition analysis performed specifically for the discussion of 
assignment to special education and grade failure. As explained in the 
section on special education, certain groups from some of the projects 
were excluded from the analysis a priori and, hence, were not included 
as part of the original sample in that attrition analysis. These groupa 
were, however, included as part of che original sample in the attrition 
analysis in the appendix. 

Table B-26 presents the results of an attrition analysis performed 
for the sample as a whole,** This analysis is meant to be exploratory 



* Budget restrictions requirea i.hai. no efforts were made to find some 
whole cohorts of subject. See also following footnote. 

*^ If no information v/as received from a project on an instrument, that 
project was not designated as part of the original sample for that 
" Instrument. Also, Karnes* groups 10-14 and Deutsch's non-self- 
selected controls and Deutsch*s wavea 5-7 were excluded from the 
original sample since they were not selected for follow-up at this 
time. 



ISO 



B- 38 



only. Three way ANOVA was performed using the following three factors: 

- which project the child was from 

- attrition status 

- program status 

Again the analysis was performed in hierarchical fashion with project 
enteied first, attrition status second, and program status third. Project 
was entered first to parcel out the variance attributable to initial dif- 
ferences between projects. Attrition status was entered second because it 
is the variable of interest and, hence, it: is more rigorous (i.e., more 
likely to arrive at a significant attrition effect) to calculate the main 
effect of attrition prior to the main effect of program status. 

As can be seen from Table 8-26, the final sample differs from the 
dropouts on pretest IQ for all d ^initions of attrition except attrLtlon 
on the WISC-R. The only other significant main effect of atLrici<>n is ua 
the ISP for the School Record. There were only two significant two-way 
Interactions Involving attrition (both between attrition and project): 
mother's education for the Youth Interview, and ISP for the school record. 
There were no two--way interactions be^tween attrition and program status 
(i.e., no evidence for di^Jf erential attrition as defined in question 3); 
however, there were six three-way interactions. Ove*-all, it appears in 
regard to whether a Bir^et was administered that the total final sample ^ 
is significantly dift^er€>nt from the total cjropouts on pretest Binet IQ 
but there is little evidence for differential attrition >>etween program 
and control groups. 

lb I 
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Attrition lu the Original Data 

The parameters f( . the analysis of attrition for each project were 
defined as follows: 



Criterion of 
Project Dropout Status 



Gordon 

ETP 

FOHV 

Karnes long 

Karnes jj-p 

Levensteln 

Miller 

Palmer 

Perry 

CD 

Carnegie 



Existence of a Blnet at age 6 

.. .. 10 

II II J 

II II g 

11- II J 

II ti c 



II W J 

" " 10 

., .. g 

II II J7 



Dependent Variables 

Blnet at age 3, SES, mother's education 

" pretest " 
II II II 2 ** 

" pretest " 

U ' II II »» 

" age 3 " 

•! " pretest " 

" age 3 " 

" ' " pretest " 

II ^ II If II ^ tl 

" age 3 " 
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TabJes B-26 thru B-28 represent the 2 X 2 ANOVA analyses xoi thexJif- 
ferential attrition on the original dats, For four projects the significance 
level? come from ditferent level ANOVA: 

- Karnes pr^-post: 2X5 groups 

- Karnes longitudinal:^ '2 X 5 groups ^ 

- Miller program comparison: 2X4 groups 
• Curriculum Demonstration? 2X3 groups 



A' can be seen, there are very few Indications of differential 
attrition* Only the Levenp^ein project on the ISP ha,s a significant 
attrition effect which contributes to an overall significant ANOVA. 
Other projects did i^how some significant attrition effects; however, 
their overall ANOVA's were not significant. 

One should note that the attrition reported here for Levenstien 

c 

is artificial due to the stipulation of this analys-'G that a subject 
must have a Bihet score at the designated posttest in order to be 
considered part of the final sample. Much of Levenstein*s "attrition" 
is caused by the fact that many of her subjects were given WISC's rather 
than Binets in late\ follow-up periods. . . 

Conclusions 

* ♦ 
The overall evidence seems to indicate that, although there are 

some instances of differential attrition, the final samples are representative 

of the original samples. Overall (v >aral attrition) there were no significant 

differences between the demographic characteristics of those subjects found 

and those not found. §juch attrition as was significant dealt with whether 

specific pieces of data were in hand on July 1, 1977. Thus, attrition 

appears to*have been a fairly random process. This conclusion is not 

surprising given the fact that much of the attrition occurred while neither 

program nor control cliildren were receiving any major benefits (or costs) 

from the project (i.e., after proje:^t terminahion) . The major reason to 

suspect biases caused by attrition is that the benefits received from the 

program will cause a different pattern of attrition in the program versus 
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control groups. Since the current follow-uo occurred several ypars after 

program termination, there is little reason no susp--ct that differential 

^ ft 

patterns of attrition would occur whan neither group was receiving benefits 
from the program. The most crucial period for which attrition must be 
investigated in evaluation research is the period of program duration* 
The question of attrition during the program has been addressed by most 
of the projects in their original reports which deal with more immediate 
posttests. The fact that less *:han 3% of the parents and/or youths 
contacted refused to participate in the follow-up eliminates any 
concerns we had abouc conteiuporaneous differential attrition* 

Explanation of Attrition Tables B-1'0 to 3-24, B -27, and B -28 
Separate tables are provideii for attrition on each of four 
instruments in the follow-up (Parent Interview, Youth Interview, WISC, 
and School Record) and for those whq had been given any instrument 
versus those not found all (the traditional concept of attrition)- 
Analyses were performed for each project on three dependent variables: 
Stanford-Bine t or PPVT pretest IQ score, Holiingshead Index of Social 
Position score, and mother's education. Thus theve are a total of 
fifteen tables (three dependent \/?riables time five measures of 
attrition status"^ 

All tables are based on separate two times two ANOVA perfonned\for 
each project.* The first factor in the ANOVA is attrition status (dropout 

* In two projects which were designed uo compare different curricula, 
the attrition analyses are performed by 2 X 5 (Karnes) and 2X4 
(Miller prop^um only) ANOVA's. These analyze differential attr^itipn 
among different program groups* Only the significance levexs are 
reported* 
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versus final sample), while the second is program status (program vs. 

control),* ANOVA is performed using a hierarchical method for assigning 

variance (SPSS Option Ten) with attrition status the first variable 

entered (L,e. the F statistic for the attrition Vtain effect is 

computed without controlling for program sl.atus). The first three 

columns in the tables present three significance lavels taken from the 

2X2 ANOVA* s. The first Is the significance level for the main effect 

of attrition .status; the second, the significance level for the 

interaction between .attrition status and program status; the third, 

the overall significance level f.n* "he 2X2 ANOVA. They are taken from 

a standard S^SS ANOVA printout. For example, the numbers for the Gra> 

' *^ 
project in Table B-5 were taken from the table on the following page. 

The last four columns give the mean score on the dependent 
variables for each of the four cells defln*>dcJ>y the 2X2 ANOVA, with 
salm^le size for each cell given in parentheses below the rnran score - 

The tables do not present all of the Information given Ln a 
standard ANOVA t;olc simply because the entire^ -analysis consists of 
almost 150 separate ANOVA* s (three dependent variables times five 
measures of attrition times ten projects). 

The las^ row in each table gives the ANOVA resu'.ts when all 
projects <)re grouped together. 

The tables are organized as follows: 

B-5 pretest IQ by Parent Interview status for ten projects 
B-6 ISP by Parent Interview status for ten prolccts 
B-7 mother's education bv Parent Interview status for ten projc 
B-8 protest IQ by Parent Interview status for ten projects 
B~^> ISP by Parent Interview status for ten projerts vtc. 

l8o 
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Attrltlog in 
the Special Education aod Grade Failure Analysis 

Due to the importance of the findings on special ^ucation and grade 
failure, additional attrition analyses were conducted specifically for 
the groups used in these analyses. Separate attrition analyses are 
presented for each project. 

I ra Gordon ^8 P arent/Education /Backyard Learning Center ^Project ; The at-- 
trition analysis for the Gordon project is reported in "School Performance 
as a Functioji of barly Stlmulation/'^^^^^ Bayley Mental Development Index, 
scores at age :wo and Stanf ord-Bihet IQ scores at ages three and six 
were compared between the 1976 sample and the sample at the end of inter- 
vention for <:ach of the groups. No significant differences were found. 
Susan Gray's Early Training Project ; The final sample and^the dropouts 
were compared on three measures: Binet pretest IQ score, head of household- 
socioeconomic status XHollingshead Index) » and mother *8 education. T-tests 
were run for the full sample ^au for progra^a and control groups separately.' 
No significant differences were found. Two by two analyses of va.*ance 
drop-oul; status x program status) for ach vari ^Iso yielded no 
significant differences. 

Both t-tests and ANOVA were run because of the problems in assigning 
main effects in ANOVA of unequal* cell sizes. The t-tqsts assign to drop- 
out status rll variance which could be attributed to dropout status, whils 
the ANOVA tests for interaction between dropout status and program status. 
rferle Karnes* Research and Development Program on Preschool Chi ldren: For 
each of three measures (pretest Stanf ord-Binet IQ, mother *o education, 
and Hollingshead SES) a 5 X 2 ANOVA (with the five experimental groups as 
one factor and dropout status as the other) was performed. Ho significant 
differences were found. The t-tests comparing the final sample with the 
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dropouts on the above measures for eiich of the experimental groups 
individually also revealed no significant difference. 

Phyllis Levenstein's Mother-Child Home Program : The Levenstein project, 
which has followed the chiV\ren aliaost annually since the inception of 
the program had data. on all but one of the program children and of all of 
the control children. Thus, there were no significant differences on 
any characteristic since there was no variance in the dropout category. 
Louise MilJLer's Experimental Variation of Head Start Curricu la; The final 
sample ^nd the dropouts were compared on pretest Stanf orrf-Binet IQ and on 
mother's education using identical procedures to those used in the Gray 
project (Socioeconomic status (SES) scores were not available for 
the control group]. No significant differences were found. 

A second analysis (4 X r ANOVA with the four experimental groups as 
one factor and dropout status as the othes) revealed no significant 
differences among experimental groups with respect to pretest IQ,«mother's 
education, or Hollingshead SES. 

Fra ncis Palmer's Harlem Tra in ing Pr oiecc: The attrition analysis reported. 

4 

by Palmer concludes: 

Attrition analysis, conducted by comparing IQ's and social class 
at ages three- and five (the last assessment) for those found and 
not found in 1975, shwed no .significant differences between any 
of the groups in the design. (14) 

David Weikart's Perry Preschool Project : The Wfeikart project was able to 
find school record data on all 123 children. - ^ 

Edward Zi Rl er's New Haven Follow-Thro ugh Study: Two measures (PPVT IQ 
scores at age five and mother's education) were compared between the droV- 

V 



outs arid the final sample by t-tests for the total sample and for the 
pTogram-an^Y°at:rol groups separately. Two by two ANOVA's (dropout s.atos 
and progTAm status) were also comput^ed": "No significant di-fferences. weie 
found on the i-tests. However, the ANOVA on PPVT IQ showed a significant- 
interaction between dropout status and experimental-control status (overall 
F=3M28 p=.028). The control dropouts had the lowest average IQ,. while 
the program dropouts had the highest average IQ. Hollingshead SES 
measures were not. available. / 
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Table B-5t Final Sample as a Percent of Original Sample by Project ; 
"General Attrition" 

O I 

' Final Final Total Final 

Controls Program Sample as ^^2 

as % of as % of % of 

Original Original Original 

Controls Program Total gainple 



Significance 



Definition of 
Original Sample 



tvjbeutsch 



^''Cordon 



Gray 



p Levenstelti 

i. miler 
Palmer 
Veikart 



48. 6* 


5A.2* 


. 50.6 


0.284 


.5943 


(5A) 


rt(32) 








6.3 


16.3 


12.5 


, 10.173 


.0014 


(12) 


/ CI \ 

(51; 




• 




33.8 


30.3 


31.1 


0.166 


.6835 


^ (23) 


(73) 


(9d) 






85. A 


U1.8 


83.7 


0.03394 


.8538 


//.IN 








- 




82.9 


82.9 








(121) 


(121) 






« 

75.6 


73.8 


74.4 


0.321 


.8836 


(59) 


(127) 


' (186) 






56.1 


50.9 


52.0 


.0011. 


.9739 


(32) 


(109) 


(141)- 






70.1 


71.9 


71.5 


. X).016 


.8980 


(A7) 


(124) 


(221) 






100.0 


"i 100.0 


100.0 






(65) 


(58) 

1 


(123) 








I 

> 




J 





full 170 cases 
sent to Cornell 

first 4 waves, groups 
1 & 2 only - 504 cases 

alF 3W~ca8e»>Jilth 
test' scored sent to 

Cornell 
all 92 cases ETP casc^ 
sent- to Cornell 

groups 1 thru 10 » 
146 cases 

all 250 cases sent tc 
Cornell, (first 5 wav6«^ 

all 270 caseo senC to 
Cornell 

all 309 cases sent to 
Cornell 

all 123 Perry cases 
sent to Cornell 



Since these figures were calculated, Beller has located additional subjects, 
Iringlng those figures up to 75% and 87% respectively. These additional data 
did not reach us In time for this analysis, and will be Included In future 
reports. However, note^that there are no significant differences between 
the sample which was on hand and the original groups. The delay In the location 
of the . slier subjects was due to an unusually complex decision process In the 
public schools. 
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Table B-6: 



Final Sample as a Percent of Original Sample 
of Parent Interviev^ by Project 





Final Controls 


Final Program 


Final Total 






Project 


as a % of 


as a % of 


as a % of 


2 


Significance 




Original 


Orieinal 










Controls 


Program 


Total 






Beller 


42.3 


52.5 


45.9 


1 V ? 0 s 






(47) 


(31) 


(78) 






Deutsch 


3.1 


13.1 


r.3 


^9 QAIfi 

-Li- • -TH iO 








(41) \ 


(47) 






Gordon 


33.8 


30.3 \ 


31. 1 




. Do 




(23) 


(73) 


(96) 






Gray 


75.0 


81 . 8 


78. 3 


0 990*^ 






(36) 


(36) 


(72) 






Karrtes 




82.2 


82.2 










(120) 


(120) 






Levens.tein 


21.8 


39.0 


33.6 


6,3335 


.0118 




(17) 


(67) 


(84) 






Miller 


56.1 




52.0 


.00107 


.9739 




(32) 


(109) 


(141) 






Palmer 


41.8' 


40.9 


41.1 


0.0001 


.9917 




(28) 


(99) 


(127) 







Weikart 



86.2 
(56) 



86.2 
(50) 



86.2 0.0641 .8001 

(106) 



^^^^ 



S''-Beller 



>peutsch 
F Gordon 



Gray 



Karnes 



Levenstein 



' Miller 



Palmer 



Weikart 



1^ . 



Table B-7: 



Final Sample as a Percent of Original 
for Youth Interview by Project 



FinaL Controls 
as a % of 
Original 
Controls 



Final Program 
as a % of 
Original 
Program 



Final Total 
as a % of 
Original 
Total 



B-49 



Significance 



33.3 


37.3 


34.7 


0.1200 


.7290 


(37) 


(22) 


(59) 






5.7 


1A.7 


11.3 


8.7512 


.0031 


(11) 


(46) 


(57) 






19.1 


12.0 


13.6 


1.7033 • 


.1919 


(13) 


(29) 


(42) 




* 


75.0 


75.0 


75.0 


0.0581 


.8096 


(36) 


(33) 


(69) 








78.1 


78.1 








(114) 


(114) 






23.1 


23.8 


23.6 


0.0009 


.9764 


(18) 


(41) 


(59) 






56.1 


50.9 


52.0 


0.0011 


.9739 


(32) 


(109) 


(141) 






43.3 


40.9 


41.4 


0.0437 


.8344 


(29) , 


(99) 


.. " (128) 






87.7 


81.0 


84.6 


0.5929 


.4413 


(57) 


(47) 


(104) 
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Table B-8; Final Sample as a Percent Original 
■ for School Record Form by Project 



Seller 

Deutsch 

Gordon 

Oray 

Karnes 

Levenstein 

yiller 

. Weikart 
ft 



Final Controls 
as a % of 
Original 
Controls 



19.8 

(22) 



(4) 
0 

(0) 

79.2 
(38) 



71.8 
(56) 

56.1 
.32) 

67.2 
(45) 

100.0 
(65) 



Final Program 
"^s a % of 
Original 
Program 



32.2 

(19) 

9.3 

(29) 

0 

(0) 

81.8 
(36) 

72.6 
(107) 

37.2 
(64) 

50.0 
(107) 

63.2 
(153) 

100^0 
(58) 



Final Total 
as a % of 
Original 
Total 



oignif icance 



24.1 

(41) 

6.5 
(33) 

0 

m- 

80.4 
(7^) 

72.6 
(107) 

48.0 

(120) 

51.3 
(139) 

64.1 
(198) 

100.0 
(123) 



0.003.3 



0.0180 



0.2036 



2.5869 .1078 
8.9578 .00'28 



.9544 



24.3505 ' .0000 



.8934 



.6519 
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Table B-9: Final Sample as a Percent of Oriplnal for WISC-R by Project 



,i Pro j^^ct 



Final Controls 
as a % of 
Original 
Gontrols 



- Seller 

r 

i - Deutsch 

< 

fk)rdon 
Gray 
Karnes 
I Levenstein 
. Miller 
Palmer 
Weikart 



0 

(0) 
0 

(0) " 
0 

(0) 

79.2 
(38) 



32.1 
(25) 

56.1 
(32) 

37.3 
(25) 

86.2 
(56) 



Final Program 
as a % of 
Original 
Program _ 



0 

(0) 
0 

(0) 
0 

(0) 

77.3 
(34) 

76.7 

X112) 

19 J 
(51) 

50.9 

(109) 

38.8 
(94) 

93.1 
(54) 



Final Tof.al 
as a % of 
Original 
Total 



X 



Significance 



0 

(0) 
0 

(0) 
0 

(0) 

78.3 
(72) 

76.7 

(112) 

30.4 

(76) 

52.0 
(141) 

38.5 
(119) 

89.4 

. 10) 



0.0011 

0.1074 
0.0011 
0.0074 
0.9172 



.9737 

.7432 
.9739 
.9316 
.3382 
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Table B-10: General Atti>itton *-. 

Comparison of Pretest Stanf ord-Blnet XQ Spores 



Project 



Beller 

Deutsch 

Gordon * 

Gray 

Karnes 

Levenstein 

Miller 

Pro gram/ Con. 

Miller 

Progratn/Cotnp. 

Palmer 

Weik^rt 



Si gnificance levels 



Attrition 
Main Effect 



Interaction 



I. 



.003 
.999 
.999 
'.999 
.999 
.999 
.306 

.999 

.111 
No Dropout 



Overall 
ANOVA 



.030 
.193 
.999 
.999 
.999 
.177 
.999" 

.999 



.001 
.999 
;296 
.999 
.999 

.m 

.308 
.220 



.056 .001 
on Scfiool Rdcord 



Mean I.Q. Scores 



Dropout 



Program 



92.32 

(25) 

92.05 

(229) 

95.38 

(80> 

89.88 

(8) 



81.79 
(42) 
92.09 
(104) 



90.62 ^ 
(34) 



Control 



84.11 
(57)- 

1.68 
(120) 
92.90 
(31) 
88.71 

(7) 



86.67 
(9) 
87.81 
(16) 



186.89 
(19) 



Final Sample 

Program Control 



92.03 
(32) 
93.51 
(45) 
94.27 
(64) 
89.33 
(36) 



84.50 
(125) 
93.62 
(109) 



95.92 
(86) 
79.57 
(58) 



\* Stanford-Binet at age three (a post test IQ) was used in this analysis 
** fPVT, pretest I.Q. ' 
*** Only half the program group was given a pretest 



92.91 
(54) 
87.00 
(9) 
89.19 
(21) 
87.08 
(37) 



82.89 
(27) 
90.44 
(18) 



84.64 
(44) 
78.54 
(65) 



\ 

\ 
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Table B-11; General-' Attrition - 

' Comparison of Holltnpshead ISP Scores* ? 



\ 



Pro j act 

Beller 

Deutsch 

■ Gordon 

■ Gray ■ 

Karnes 

Levenstein 

Miller 
(Program & 
Control) 

Miller 
(Program 
Comp . ) 

Palmer 

Weikart 



Significance Levels 



Attrition 
Main Effect 



No ISP data 

.310 
No ISP data 

.939 

.999 

-.999 



Interaction 



No ISP data 
.999 , 

.024 
No Dropouts 



.999 
received on 
.007 
.999 
.097 



on controls 



.999 



999 .105 
on School Record 



"V 

— r 



Overall \ 
ANOVA 



.999- 
controls 
.058 
.999 
.•315 



.999 



Mean ISP Scores 



D ropout 



Program 



66.<71 
(45)- 



63'. 60 
(5) 



66.23 
(44) 



56.75 
(64) 



Tinal Sample 



Control • 


r -ogram 


Control 


66.05 


65.05 


62.67 


(74) 


t40) 




74.14 


70.52 


69.00 


(7) 


(31) 


(39) 


63.79 


64.17 


66.00 


(19) 


(125) 


(59) 


52.85 


59.12 


59.04 


(20) 


(164) 


(47) 




67.81 


69.09 




(58) 


(64) 



*fhe Hollingshead Index of Social Position (ISP) ranges from 11 to 77, with 
"11'' representing the highest social class and **77" representing the lowest 
social clasi^. * ^ 
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Table B-12 : General Attrition - 



Comparison of Mother Education 



I-., -Project 



Si gnificance Levels 



Attrition 
Main Effect 



>Beller ^ 
Deutsch " 
S:., .Gordon 
-Gray 
Karnes 

Levenstein 

Jo o 

:\ Miller 
^ Program/ Con. 

■Miller 
Program/Comp. 

Palmer 

Weikart 



No educatijn data \ 



.999 

Education 
two con trolls 
.157 

.999 

.999 „ 

.999 

.999 

.158 ^ 
No Dropouti 



Interaction 



.097 
ata received 
.018 
.335 
.139 
.999 

.999 



.999 

on School Record 



Overall 
A>;OVA 



.999 
on only 
.048 
.4^1 
.999 
.999 

.999 
.999 



Mean Grades Completed 'y 



Dropout 



Program Control 



10.36 

(45) 



9.67 
(6) 



10.27 
(44) 

10.89 
(95) 



11.45 
(65) 



10.03 
(74) 



7.00 

(7) 



iO.84 
(19) 
10.67 
(15) 



11.50 
(20) 



Fijal Sataple 



Program 



9.9!5 
(411 



8.7!i 

OA'; 



10.^ 

(126>- 
10.87 

(loa) 



11.12 
(167) 
9.47 
(58) 



Control 



12.00 
(3) 



9.68 
(41) 



10.21 
(59) 
10.29 
(17) 



11.23 

(47) 

9.3P 

(65) 
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Table B-13t 
^ — 



Attrition on the Parent Interview - 
Comparison of Pretest Stanf ord-Blnet IQ Sc;ore.s 



j Slgnificance Level^ 



Attrition 
>lain Ef f ect 



k^Mutsch 
feiSordon ,5* 




^tevenstein ** 

[^.jSHiler 
|S .Pi*ograin/Cotf . 

l^miler 

J:' iProgram/Comp. 

Vpfalmer *** 

1;:; Weikart 



6 



6:- 



.079 
.999 
.999 
.999 
*'.999' 
.026 • 
.306 

.999 

.999 
.999 



Interaction 



.186 
.194 
.999 
.999 
.999 

:999 
.999 

.999 
.999 



Overall 
ASOVA 



.067 
.999 
.296 
.999 
.999 
.062 
.308 

.220 

.001 
' .999 



Mean I.Q. Sqor^ 



Dropout 



Program 



92.46 

(26) 

92.08 

(239) 

95.38 

(80) 

89.88 

(8) 



82.13 
(100) 
92.09 
C104) 



93.21 
(72)' 
'81.00 
(8) 



Control 



86.22 

(64) 

91.59 

(12 0 

92.90 

(31) 

87.17 

(12) 



83.82 
(36) 
87.82 
(16) 



85.42 
C36) 
78.00 
(9) 



Final Sample 



Program-,, C6ntrpl 



91.90 
(31) 
93.74 
(35) 
94.27 
,(64) 
89.33 
(36) 



86.33 
(67) 
93.62 
(109) 



96.23 
(48) 
79.34 
(50) 



* Stanford-Bine t at age three (a posttest IQ) was used in this analysis. 
,** ^>PVT pretest I.Q. 

*** Only half of the' program group was ^iven a pretest. 



(47) ' ' 

85.40' 

(5) 

89.19 

(21)' 

87.41 

(32) 



(0) 

90.44 
(18) 



85.19 
(27) 
78.63 
(56) 
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Table B-]4; Attrition on the Parent Interview - 



Comparison of HollinRshead TSP Scores 



B-56 



Proj ect 

Beller 

Deutsch 

Gordon 

Gray 

Karnes 

Levenstein 

Miller - 
Program/ Con. 

Miller 

Pr^ogram/Comp. 

Palmer 

Weikart 



Significance 


Levels 




MeaniSP 


Scores 




Attrition 
I'lci Hi 1 1 c L 


Xri Lc Ld UXULl 


AXOVA 


Dropout 


Final Sampld 


Program 


Control 


Program^ 


Control 


No ISP dat.3 


I 






4 






• 152 


.999 


QQQ 

. yyy 


67.02 


65.93 


64.21 


65.00 






. (52) 


(76) 


(33) 


(1) 


No ISP dat, 


I received on 


controls 










.999 


.002 


.019 


63.60 


74.09 


70-52 


68.43 






(5) 


(11) 


(31) 


(35) 


.999 


.999 


.999 










.156 


.213 


.222 


'64.33 


64^.56 


65.27 


68'. 71. 






(102) 


(61) > 


(67) 


(17) 


.306 


.999 


.308 










.,999 ' 


.999 


.999 










.999 


.999 


.999 


CO 1 r\ 
5o. 10 


DO . oy 


JO . ^ ~« 


.57.89 






(133) 


(39) , 


(95) 


(28) 


.306 




QQQ 


65.13 


68.00 


68.24 


69.27 






(8) ^ 


(9) 


(50) 


(55) 














































1 













» * The Hollingshead ISP (Index of Social Position) ranges from 11 to 77 with "11" 

representing the highest social class and "77'' representing the lowest social class, 
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Table B-15; Attrition on the Parent Interyflew 
~, Comp arison of Mother* s Education 



Si piificance Levels 



# ;Project 



Attrition 
Main Effect 



r :Beller 



T)eutacih 

/ 

Gordon 



Karnes 
Levenstein 

Mller 
r .Program/ Con. 

5, „mier 

, Program/ Comp. 

Palmer 

.Keikart 



No Educatlpn 
.999 

Education 
two contro 
.062 

.999 

.076 

.999 

.999 

.999 
.999 



Interaction 



data 
.269 
(lata received 
.014 
.340 
.999 
.999 

.999 



.999 

-058 



Overall 
AKOVA 



999 
bn only 
.018 
.416 
.276 
.999 

.999 

.999 
.211 



Mean Gracles Completed 
Dropout 



Program 



10.43 
(53) 



9.67 
(6) 



10.74 
(103) 
10.67 
(■95) 



11.30 
(134) 
8.00 
(8) 



Control 



10.08 
(76) 



.42 

(12) 



10.56 
(61) 
tlO.89 
(15) 



11.26 
(39) 

1.78 ' 

(9) 



Final Sample 



Pro gram 



9.73 
(33) 



8.79 
(34) 



10.27 
(67). 
10.87 
(100) 



11.09 
(98) 
9.70 
(50) 



Control 



12.00 
(1) 



9.92 
(35) 



9.88 
(17) 
0.29 
(17) 



11.39 
(28) 
9.32^ 
(56) 
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Table B-16: 



B-58 



Attrition on the Youth .Interview - ^ 
Comparison of Pretest anford-Blnet IQ' sjores 



Project 



^Seller 
Deutsch 



Gordon* 

f: .Gray 

^^^^ 

^:'Xarnes 

Levenstein ** 

i; Miller 
;:^Program/Con. 

mier * a: . 

Program/ Co inp. 
r Palmer*** • 
Weikart 



Significance 


Levels 




Meaih I.Q. Scores 


f 


Attrition 
Main Effect 




Overall 


Dropout 


Final /Sample. 


Interaction 


ANOVA 


Prpgram 


Control 


jrrogrpui 


Pnn ^■rr.1 




. UZU 


e 


92.71 
(35) 


85.49 
(74) 


91.271 
(22)1 


94.19 
« (37) 


.999 
'.999 
.999 
.265 , 


.999 
.999 
.999 
!999 


'.999 
.-367 
.999 
.999 


91.94 
(233) 
95-. 27 
(116) 
88.73 
(11) 


91.48 
(121) 
90.98 

(40) 
88.09 

(11) 


94.291 
(41^ 

93.29 
(28:? 

89.67 
(33) 

/ 


89.38 
(8) 
92.83 
(12) 
■ 87.09 
C33) 


.068 ' 




.175 


82.88 
(126) 


83.83* 
(36) 


86.^8 
(4/L) 


(0) 


.306 


.999 


.308 


92.09 
(104) • 


87.81 
(16) 


93i62 
(109) 


90.44 
(18) 


.999 


.999 


.220 






> / 




.999 


.999 


.001 


93.29 

(73). 


85.17 
(35) 


96.17 
(47) 


85.50 
(28) 


.999 


.999 


.999 


80.55 . 

(11) 


79.75 


79.34 

) 


78.36" 




\ 




i 

/ 

/ 






181 



*, Stanford-Binet at .age tfttee (a posttest' IQ) was used in chis analysis, 
** PPVT pretest I.Q. 
*** Only half the program group was, given a pretest. 
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Table 17: Attrition on the Youth Intervie w - 

Comparison of Hollingshead ISP Scores^ 



tV:.^Eroject 

Wr~^ — 

§t"Bel,ler 

If--' 

I^Deutsch 



.Gordon 



rr::Karnes 



|^^JLfe5;finstein 

|.,c{aier 

-Prpgrap/ Con . 

|: Miller 
¥ Pro-am/ Comp 

h ' Palmer 

Weikart 



Sip^nificance 


Lev Is 




Mean ISP 


Scores 


r-- 


Attrition 
Main Effect 




Overall 


Dropout • 


Final Sample 


Intfractlon 


ANOVA 


Program 


Contro] 


Program 


Control 


No ISP data 
'.999 


.999 


,999 


6^A 
■ (48> 


66.05 
(74) 


• 

65.78 

(37) ,. 


62.67 
(3) 


• No- ISP dat! 


I received on 


Controls 










.999 


.227 


.599, 


68.13 
(8)*- 


71.75 
(12) 


69.96 
(28) 


69.09 
(34) 


.999 


.9S9 


.999 










.271 


.080 


.196 


(128) 


64.42 
(60) 


64.68 
(41) • 


68.94 

(.■^8) 


No ISP dat; 


I on Controls 












.999 


.999' 


.999 ' 










.999 


,999 


.999 


' 58.26 
(133) 


56.66 
(38) 


58.72 

(95) 


57.90 
(29) 


.016 


.999 


.081 


63.09 

(iir . 


66.50 
(8) 


68.91 
(47) 


69.46 
(56) , 


» 


) 













* The Hollingshead Index of Social Position (ISP) ranges from 11 to 77, with 

representing the highest social class and "77" representing the lowest social 
class. ' 
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Table Attrition on the. Youth Interview 

Comparison of Mother* s Education 



Significance Levels 



.Project 



Attrition 
Main Effect 



:p;^Beller 



tellf^tsch 
'fehGordon 
ri:/Gray - 



£%r Karnes 



^Levensteln 

iC:- - - 

Miller 

."Program/Con . 

'ff^ Miller 

|- ;' Program/Comp. 



%1\ 



Palmer 



Weikart 



No educatlor 
• 99S 



Education 
only two 

.001 
.999 

•oir 

\999 
. .999 



data 



controls 



.959 



.303 



Interaction 



"] CK'erall 
ANOVA 



data 



.269 

received oK 



. .172 

.999 
.999 

.999 
.999 
.,..999 ' 
.037 



.?-:99 

.003 

.999 
.088 

.9''9 
..999 
.999 
.142 



Mean ^rad-? Cniepleted 



\ Dropout 



Program 



ID. 4 2 
(48) 



8,00 
(9) 

10.73- 
(129) 

10.89. 
(9,5) 



11. 3 L 
(134) ^ 

8.18 
(11) 



Control 



10.03 
(74) 



7.17 
(12) 

10.60 

(60) 

10.67 
(15) 



11.29 
(38) 

10.00 
• (8) 



Final Sample 



Program 



9.84 

(38) 



-9.19 
(31) 

10.00 
(41) 

(100) 



11.07 
(98) 

9.77 
(47) 



Control 



12.00 
(3) 



10.. 00 
(36) 

9.78 

(18^ 

10.29 

\ci } 



11.34 
(29) 

9.30 
(57) 
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Table B-19: Attrition on the School Record - 

^ ' Conparlson of Pretest Stanford-Blnet IQ 



Scores 



ect 



Slf pilf icance Levels 



Attrition 
Main Effect 



^Ifieutsch* 

feSoirdoh-*, 



^^^^ > ^ 
t^tevenstein ** 

*rpgracr/Con» 

l^paier' 
""^Brogram/Con^ • 



Falicer 



• 002 
.117 



Interaction 



.005 
.999 



No school records recei\ 



.999 
..999 
.999 
.999 

.999 

.105 
No Dropouts 



.999 
. 313 
.999 
.999 

.999 
.194 



Overall 
ANOVA 



.001 

.324 ; 

.999 
.999 
.^999 
.319 

.228 
.001 



Mean I.Q. Scores 



Dropdtit . A 

Prop,ram | Control 



92.39 
(38) 
91.88 
(248) 



89.83 
(8) 



84.26 
(105) 
92.14 
(106) 



91.10 
(42) 



85.92 
(89) 
91.40 
(125) 



86.40 
(10) 



36.66 
(9)- 
37.81 
(16) 



$5.48 

;21) 



V'Lnal S ample 



Program 



91.68 
(19) 
96.23 
(26) 



Control 



98.36 
(22) 
89.75 
(4) 



o:; j87«62 
(36) !l(34) 



83.06^V-' 
-(62) 
93.60 
(107) 



96.21 
(78) 
79.57 
(58) 



82.89 
(27) 
90.44 
(118) 



85.24 
(42) 
78.54 
(65) 



Stanford-Binet at a?e three (a posttest IQ) was used in this analysis . 



■f* PPVT pretext I^Qi 



fx- .*** c»ly half the program group was given a pretest ' ' ' 




f 
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Table B-20; Attrition on the School Record - 
f^' , Comparison of nhe Hollingshead ISP Scores* 



V - 


Significance 


Levels 




Mean ISP 


Scores 






Attrition 
Main Effect 




Overall 


Dropout 


Final Sample 


I.. 

\^ Project 


Interaction 


AKOVA 


Program 


Control 


Program 


Lontroi 


t Beller 


No ISP data 














1 ; Deutsch 


.999 






66.36 
(61) 


65.92 
(77) 


64.83 
(24) 


(0) 


|L._.Goxdon 


No ISP data 


received on 


;ontrols 










1- ^ Gray 
it_ Varnes 


.999 
.999 


.030 
.999 


.175 
.999 


63.60 ' 
(5) 


71.50 
(10) 


70.52 
(31) 


69.31 
(36) 


V Levenstein 


.999 


.999 


.999 


65.18 
(107) 


65.05 
(22) 


63.89 
(62) 


65.63 
(56) 


1^ Miller 
£__Pr 0 gr am/ Con . 


Nn TSP data 


on controls 


1 










] Miller 

^ — gram/Comp. 


.999 


.999 


.999 


V 








? . . Palmer 


.006 


.999 


.043 


55.76 
(79) 


53.82 
(22) ' 


58.84 
(45) 


5i'.88 
(149) 


Weikart 


No dropouts 










67.81 
(58) 


69.09 
(64) 



















* The Hollingshead Index of Social Position (ISP) ranges from 11 to 77 , 
with "11" representing the highest social class and "77" representing 
the lowest social class. 
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Table B-21: Attrition on the School Record - 
C omparison of Mother* s Education 



1^: 





Significance 
\ttrition 
^►lain Effect 


Levels 


Overall 


Mean Grades. CamDlei 
Dropout 


pd 

Final, Sample 


Ir-iProiect ^ 


Interaction 


ANOVA 


Program 


Control 


Program 


Control 


— ^ 

g^Beller 


No £ducati3 


n data 














.143 




.249 


10.42 
(61) 


10.10 
(77) 


9.52 
(25) 


(0) 


fe^Gordon 


Education i 


ata received 


on only 




- 






r^^Grav 


tWO COuutO 

' .999 


.065 


.182 


Q A7 

(6) 


7 QO 
(10) 


8 .79 
(34) 


9.66 
(38) 


: Karnes 


.045 


..999 


.261 










t Levenstein ^ 


.999 


.999 


.999 


10.43 ^ 
(107) 


10.23 
(22) 


10.76 
(63) 


10.48 

(56). 


1 Miller ' 
^'Program/ Con. 


.999 


.999 


.999 


10.88 
(97) 


10.67 
(15) 


10.89 
(98) 


10.29 
(17) 


: Miller 


.999 


.999 


.999 










' Ptogram/Comp. 
















^^,Palmer 
^ Weikart 


.198 

No Dropout 


.999 

5 


.999 


11.42 
(81) 


11.50 
(22) 


11.10 
(151) 
9.47 
(58) 


11.22 
(45) 
9.38 
(65) 


I* 

« 






4 
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T able B-22: Attrition on the jJlSC-R - 

Comparison of Pretest Stanford -Blnet IQ Scores 



Signi ficc>>>ce Levels 



Bgo ject 



Attrition 
Main Ktfect 



% ' ^ Beller 
if; ieutsch 



Gordon * 



iC^ Gray 

Rarnes • 
I ■ -Levens tein** 



Miller 
Program/ Con. 

Miller 
Program/ Comp 



Palmer 
Weikart 



No WISC-R 
No WISC-K' 
No . WISC-R 

.999 

.217 

.036 

.306"' 

.999 

v216 
.174 



Interaction 



s received 
3 received 
3 received 
.999 
.999 

.999 



.999 

.999 
.999 



Overall 
AKOVA 



.999 
.999 
.096 
.308 

.270 

.001 
.306 



\ 



Mean I.Q. Scores 



Dropout 



Program 



91.40 
(10) 



82.74 
(117) 
92.09 
(104) 



93.2 5 
(75) 
80.00 
(4) 



Control 



86. 'tO 
(10) 



83.83 
(36) - 
87.81 

(11>) 



84.87 
(39) 
81.89 
(9) 



Final Sample 



Program 



88.85 
(34) 



86.32 
<50) 
93.6^^ 
(109) 



96.36 
(45) 

7#.5^ 
(^54) 



* Stanford-Binet at age three, (a posttest IQ) was us^d in this analysis 
** PPVT pretest I.Q. 
*** Only l>alf the program group was given a pretest 



Control 



87.62 
(34) 



(0) 

90;4A 
(18) 



86.04 
(24) 
78.00 
X56) 



2Q8 



- 1 
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Table B-23; Attrition on the WISC-R - 

Comparison of the Hollingshead ISP Scores 



^|Beiier*> 
^^utsch 



IflCbrdoh 



iJCGray 1. 

^3;evensteln 

fefttUer ^ 

^trErogram/Cori. 

\ - ^ ' 
iJMiller 

f?r!program/ Comp . 
ll^Paimer 
1^ /Weikart 



Si f;nificance Levels 



Attrition 
Main Effect 



No. ISP data 
No WISC's research 
No ISP data 



received on controls 



.999 
.999 
.999 

No ISP data 
.999 

.Otf6 

■J 

.999 



Interaction 



a56 
;99^ 
.032, 

an controls 
.999 

.999 

.999 



Overall 
ANOVA 



.999 
.999 
.174 



.999 
.043 
.999 



Mean ISP. Scores 



Dropout 



Program 



-66.86 
(7) 



65.21 
(119) 



57.5b 
(138) 

67.50 
(4) 



Control 



71.50 
(10) 



64.36 
(53) 



56.33 
(42) 

67.11 
(9) 



Final Sample 



Progr am 



70.21 
(29) 



63.50 
(50)J 



Control 



59.91 
(90) 

67.83 
(54> 



69.31 
(36) 



67.80 
(25) 



58.64 
(25) 

69.42 
(55) 



* The Hollingshead Index of Social Position (ISP) ranges from 11 to 77, 
with "11" representing the highest social class and "77" representing 
the lowest social class. 
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Table B-24: Attrition on the WISC-R - 

Comparison of Mo therms Educatio n 



Si gnificance Levels 



Attrition 
Main Effect 



'^^Belier 



Detitsch 



^Cordon 



|e;^":.Gray 



Karnes 



Levenstein 



miler 



I;.::: Program/ Con. 

&5 Miller 
~*'v Program Comp. 

Palmer 



Weikart 



No Education data 



No WISC's 
No WISC's 
.110 
.999 
.999 
.999 ■ 

.999 

.999 
.161 



Interaction 



received 
received 
.?.53 
.219 
.999 
.999 

.999 

.999 
.999 



Overall 
MOVA 



.232 
.329 
.999 
.999 

.999 

'.999 
.999 



tfe an Year s qf.Jducation 
Dropout 



Program 



8.-75 
(8) 



10.62 
(120) 
10.89 
(95) 



11.29 
(139). 
10.50 
(A) 



Control 



7.90 
(10) 



10.55 

(53) 

10.67 

(15)-. 



11.26 
(42) 
10.11 
(9) 



Final Sample 



Program 



8.97 
(32) 



10.40 
(50) 
10.87 
(100) 



it.t:o" 

(93) 
9.39 
(54) 



Control 



9.66 

(38) 



10.1^ 
(25) 
10.29 
(17) 



ir."*o 

(25) 
9.27 
(56) 
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Table B-25: Expected'^ Number of Chance "Significant Findings" 
a nd Actual Number of Significant Findings 
for Tables B-10 to B-2A 



Expected Number Actual Number 

of "Significant of Significant 



, Table 


Findings"* 


Findings** 


B-10 


1 


,2 


B-11 


1 


2 


B-12 


1 


i 


B-13 


1 


1 


B-14 


1 


1 

%. 


0-15 


1 


l: ' 


B-16 


1 


2. 


B-17 


X 


1 


B-18 


1 

1 


3 


B-19 


1 


2 


B-20 


1 


2 


B-21 


1 


, 1 


B-22 


1 


1 


B-23 


1 


2 


B-2A 


1 i 


0 



'Difference 



+1 



+1 



+1 



+2 
+1 



?5 



+1 
-1 



* If there were no atcrition, i.e., by chance. Rounded to nearest integer. 
On Attrition Main Effect or Interaction Attrition X Program Status. 



211 



If fV '~ 



Table 6-26: Results of. 3'Way ANOVA:^ Significance Levels 



Effects lavolving Attrition 



Attrition 
Main Effect 



g^^Pareht Interview 



^^retest -I.Q. 



^J;;Mother's Ed. 
Mk Voath Interview 
1 " .pre rest I.Q« 

Iv'Mother's Ed. 

School Record 

|lit"prerest I.Q' 
• ISP 

^.Mother's Ed. 
WISC-R 
pretest i.Q. 

: isp- ■ 

Mother "^s Ed. 
"General" 
pretest I.Q. 



ISP 



-er's Ed. 



.034 
.252 
.999 

.011 
.280 
.999 



.001 
.041 
.305 



.106 
.130 
.999 



.003 
.175 
.999 



Interactions 



Project X 
/ttrition 



.999 
.999 
.119 



.999 
.999 
.001 



.999- 
.052 
.140 

\ .999 
.999 
.19.6 

.416 
.190 
.999 



Program Status 
X Attrition 



3 Way 



.999 
.999 
.999 

.999 
.999 
.999 



.999 
.999 
.999 



.999 
.999 
.999 

,999 
.999 
.999 



Other Main Effects 



Project 
I-Iain Effect 







.999 


,001 


.185 


.001 


.004 


.001 


.1«7 


.001 


.999 


.001 


.031 


.001 


.036 


.001 


.217 


.001 


.151 


.001 


.999 


.001 






.313 


.001 


.999 


, '.001 






.043 


.001 


.090 


.001 


.003 


.001 



Program Status 



.001 
.999 
.999 



.001 
.999 
.999 

.001 
.999 
-999 



.001 
.^99 
.999 ^ 



.001 
.999 
.999 



Interaction 
Project X 
Program 
Status 



.024 
.999 

.999 ^^s^ 

.017 
.999 
.999" 



.020 
.999 

.999 



Overall 
ANOVA 



.038 
.999 
.999 



.045 
.999 
.999 



.001 
.001 
.001 . 



.001 

5 

.001 
.001 

vOOl 
.001 
.001 



.001 
.001 
.001 

.001 
.001 
.001 



D.F. 



1402 
1320 
1401 



1402 
1320 
1401 



1402 
1212 
1286 



831 
1031 
1102 



1402 
ii20 
1401 



teller 
Setitsch 
^Gbf dbn * 
Way ETP 



IJCarnes P-P 

^]tnes Long 

* 

^tevens.tein 

^ - . ^ / 

iMiiler P-C 

^ ^_ 

iMiller P only 

t 

<~ 

/ 

&Paimer *** 
|$.crry ^ 



::.C. ^Dem • 
t Carnegie 



Table B -27; Attrition on the Original Data - 

Comparison of Stanford-Blnet Ptefest IQ Scores 



Significance Levels 



Attrition 
Main Effect 



Interaction 





Mean I.Q. 


Scores 






Overall 






Final Sample 


ANOVA 


Program 


Control 


Program 


Control 


.272 


nil c "7 


OO .30 


Q1 


88 36 




(7) 


(12) 


(50) 


^-(99) 


.094 


Q1 OA 


Q1 07 


97.28 


103.00 




(256) 


(126) 


(18) 


(3) 


.99§' 


94.17 


92.00 


95.07 


91.31 


(30) 


(7) 


(114) 


(45) 


.100 


78.00 X. 


90.67 


Q1 9A 


86.82 


(6) 


(6) • 


(38) 


(38) 


^130 - 




A'^ no 


QQ 1 Q 

oo . xy - 






(1) 


(27) 


(13) 








- - " . 




.001 


























'-A 
1 




-.299 




o3 . uu 


8S 51 


80.80 




(97) 


(26) 


(70) 


(10) 


.999 


7^ . .I/O 


90.00 


92.'7fe' 


89.07 


(40) 


(5) 


(173) 


(29) 


. .229 










\- 








• 1 


. uu± 




89.41 


93.29 


QO^ QO 


(30) 


(17) 


(198) 


(46) 


.999 


81.00 


81.50 


79.54 


78.12 


(1) 


(8) 


(57) 


(57) 


.999 










.282 


91.50 




; 105.50 


100.44 




(2) 


(0) 


(18) 

( 


(18) 



icicic 



.999 .999 

.019 I .999 

.999 ' .999 

.246 .035 

.058 .999 

i\ 

.999 

.999 .999 

.263 .11-7 

.999 .999' 
.999 . ...999 

.999 , .110 

.243 .999 
.159' ^ 
.250 



Stanford-Binet at age three (a posttest IQ) was used in this analysis 
PPVT pretest I.Q. '""'^ • o 

Only half the program group was given a pretest. 
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Table B--28; Attrition on the Original Data - 
Comparison of ISP Scpres* 



:pBel-ler - 
||]Deut:sch<> 



SSordon 



;rray ETP 



f^Knrnes P-P 



k fcirnes Long 
,Levens.telh 
Miller P-C 



; Miller P only 



Palmer 



^Perry 



C. Dem 



Carnegie 



/ 



Significaace Levels 



Attrition 
Main Effect 



Interaction- 



No ISP data 



.252 



No ISP data 



.320 



.999 



,114 



,019 



.025 



.999 
.071 

.999 
.999 ^ 
No ISP SCO 



.9<5^ 



on Controls 



.999 



.999 



.99^ 



.041 



Overall 
ANOVA 



.999 



.999 
.329 
.023 
.389 
.027' 



No\sP dat^ on Controls 



.999 



.274; 



.999 

J \ 



.^99, 
es" available 



.99'9 



.211 



.999 



.999 



Mean* ISP Scores 



Dropout 
Program 



.73.00 
(4) 

61.67 
(3) 



Control 




66.66 
.(73) 

61. 7u 
(27) 



71.^00 
(6) 

w9.00 
(1) 



Final Sample « 
Program I Control 



69.13 
(32) 

65.52 
(27). 



65.15 
(72) 



k53.81 

69.00 
(1) 



56.84 
(19) 

I 

67.13 
(8) 

I., 



/ 



63.17 
(96) 

63.42 
(143) 



59.07 
(201) 

67.79 : 
(56) 



69.6 
(46) 



68.80 
(15) 



6?. 22 

a.) 



57.33 

(48) 

69.38- 
(57) 



lERlC 



* The Hollingshead Index of Social Position (ISP), ranges from 11 to 77, 
with "11" representing the highest social cl^ss and "77" representing 
the lowest social class, ^ 2j[[> 



Table B-29: Attrit m on the Original Data - 
Oomparison of Mother's Education 



Signiricance Levels 



Attrition 
Main Effect 



Interaction 



No Mother Education Da^a 
.999 .211 
No Mother 'i Education Daia 



.190 
.999 
.164 
.050 
.999 

.999 
.999 
.999 
.120 



Overall 
ANOVA 



.999 



.999 



.999 



.341 



.999 



\ 



.042 



.209 



,222 



.999 



> .999 



,264 



.999 
.260 
.999 
.377 
.999 

.353 
.298 
.999 
.380 
.143 
.054 



Mean Grades Completed 



Dropout 



Program 



Control 



10.34 
(64) ' 



8.40 
(5) 

fO.67 
(3) 



10.60 
(73) 

10.86 
(36) 



11.19 
(27.) 

10 #00 

(1> 



11.50 
(2) 



10.04- 
(69) 



8.00 
(6) 

ia.ob 
(1) 



10.40 
(72) 

n.4o 

(5) 



11.53 

(19-)' 

8.13 
(8) . 



14.00 
(1) 



Final Sample 
Program I Control 



9.64 
(22) 



9.00 
(35) 



10.53 
(30) 



10.50 
(97) 

10.89 
,(159) 



11,21 
(205) 

9.46 
(57) 



10.30 
(20) 



10.63 
(8) 



,9:48 
(42) 



9.40 
(15) 



10.52 
(6) 

10.30 
(27) 



11.23 
(48) 

9.56 
(57) 



10.82 
(33) 
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Appendix B-A 

RELATIONSHIP OF CURRENT RESULTS ON SPECIAL EDUCATION 
AND GRADE FAILURE TO '^PRELIMINARY FINDINGS OF 
^ THE DEVELOPBSNTAL CONTINUITY LONGITUDINAL STUDY" 



The results reported iri .this paper differ slightly from those reported 
in "preliminary Findings of the Devel^ meiital Contihuity Longitudinal Study 
The causes'^of these- differences are as follows: ' • ' . 

Gray ; Notification of changes in the grade failure information on two, 
subjects (one from "missing data" to "failure" and one from "no failures" 
to "failure")-. * • 

Levenstein : The after^-only dontrol group (twenty-seven children) was 
ex^^ed from this analysis for the reasons listed in Appendix B-1. v 
Miller ; Four changes affected the Miller results: 

- Speech and Hearing classes were excluded from the definition of 
'special education for Reasons explained in footnote 1. This 
resulted in the shift of six cases (five program and one control) 
from "special education" to "no special education*" 

' - One child who had been listed as "special education (undefined)" 
^ had actually been in an advanced class and, hence, was reclassified 

as "no special education." 

- An after-only control group (thirteen children) was excluded from 
the grade faiure analysis. The group was not part of the original 
experiTiental design and was excluded for design^ reasons similar to 
those resulting in the exclusion of Levenstein's "af ter-o-;ly** 
group. Tlie group had not been included in the special education 
analysis in "Preliminary Findings..." but had been included in the 
grade failure analysis. 
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- Data was received on two additional children. This affected only . 
the grade failure analysis because the special education'^formation ' 
was missing for both children. 
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A ppendix B-5 
GLOSSARY . 

• ACYF Administration for Children,' Youth, and Families ^ • 
ANOVA Analysis of Variance 

-CD Curriculum Demonstration Project (Weikart) 

« 

DARCEE Demohstratlon and Research Center for Early Education developed . 
at Peabody College (Miller) 

ETP Early Training Project (Gray) 

ETS Educational Testing Service 

FOHV Family Oriented Home Visitor Program (Gray) 

• GOAL Game Oriented Activities for Learning (Karnes' Ameliorati^je) 

ISP Index of Social Position 

NERA Northeastern Educational Research Association 

OCD Office of Child pevelopment (t^ow ACYF - Administration for Children 
Youth and Families) 

OEO Office of Economic Opportunity _ 

PCC Parent-Child Center 

. PCDC Parent-Child Development Center 

PPVT Peabody Picture Vocabulary Tept 

SES Socio-economic Status 

SPSS Statistical Package for^the Social Sciences 

WAIS WesclAer Adult Intelligence Scale 

wise Weschler Intelligence Scale for Children 

WISC-R Weschler Intelligence Scale for Children, Revised 
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